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ABSTRACT 

This report describes the High Performance Computing 
and Communications (HPCC) initiative of the Federal Coordinating 
Council for Science, Engineering, and Technology. This program is 
supportive of and coordinated with the National Information 
Infrastructure Initiative. Now halfway through its 5~year effort, the 
HPCC program counts among its achievements more than a dozen 
high-performance computing centers in operation nationwide. Traffic 
on federally funded networks and the number of local and regional 
networks connected to these centers continues to double each year. 
Teams of researchers have made substantial progress in adapting 
software for use on high-performance computer systems; and the base 
of researchers, educators, and students trained in HPCC technologies 
has grown substantially. The five HPCC program components in 
operation at present are: (1) scalable computing systems ranging from 
affordable workstations to large-scale high-performance systems; (2) 
the National Research and Education Network; (3) the Advanced 
Software Technology and Algorithms program; (4) the Information 
Infrastructure Technology and Applications program; and (5) the Bas'c 
Research and Human Resources program. Components of each are 
reviewed. Twenty-five tables present program information, with 72 
illustrations. (SLD) 
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A. Nico Habermann (1932-1993) 



This "Blue Book" is dedicated to the memory of our friend and colleague, 
A. Nico Habermann, who passed away on August 8, 1993, as this publication 
was going to press. Nico served as Assistant Director of NSF for Computer 
and Information Science and Engineering (CISE) for the past two years and 
led NbF's commitment to developing the HPCC Program and enabling a 
National Information Infrastructure. He came to NSF from Carnegie Mellon 
University, where he was the Alan J. Perlis Professor of Computer Science 
and founding dean of the School of Computer Science. He was a visionary 
leader who helped promote collaboration between computer science and other 
disciplines and was devoted to the Development and maturation of the 
interagency collaboration in HPCC. We know Nico was proud to be part of 
these efforts. 
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EXECUTIVE OFFICE OF THE PRESIDENT 
OFFICE OF SCIENCE AND TECHNOLOGY POLICY 

WASHINGTON, D.C. 20506 



MEMBERS OF CONGRESS: 

I am pleased to forward with this letter "High Performance Computing and Communications: 
Toward a National Information Infrastructure" prepared by the Committee on Physical, 
Mathematical, and Engineering Sciences (CPMES) of the Federal Coordinating Council for 
Science, Engineering, and Technology (FCCSET), to supplement the President's Fiscal Year 
1994 Budget. This report describes the FCCSET Initiative in High Performance Computing and 
Communications* 

The interagency HPCC Initiative is developing computing, communications, and software 
technologies for the 21st century* It is making progress toward providing the high performance 
computing and communications capabilities and advanced software needed in critical research 
and development programs* The HPCC Program is fully supportive of and coordinated with the 
emerging National Mormation Infrastructure (Nil) Initiative, which is part of the President's and 
Vice President's Technology Initiative released February 22, 1993. 

To enable the NH Initiative to build on the HPCC Program, the FCCSET CPMES High 
Performance Computing, Communications and Information Technology (HPCCIT) Subcommittee 
has included a new program component, Information Infrastructure Technology and Applications 
(IITA). It will provide for research and development needed to a address National Challenges, 
and it will also address problems where the application of HPCC technology can provide huge 
benefits to America. Working with industry, the participating agencies will develop and apply 
high performance computing and communications technologies to improve information systems 
for National Challenges in areas such as health care, design and manufacturing, the environment, 
public access to government information, education, digital libraries, energy management, public 
safety, and national security. IITA will support the development of 'the Nil and the 
development of the computer, network, and software technologies needed to provide appropriate 
privacy and security protection for users. 

The coordination and integration of the interagency research and development strategy for this 
Initiative and its coordination with other interagency FCCSET Initiatives has been led very ably 
by the CPMES and its HPCCIT Subcommittee. Donald A. B* Lindberg, Chair of the HPCCIT 
Subcommittee, his interagency colleagues, their associates, and staff are to be commended for 
their efforts in the Initiative itself and in this report. 




5 



Office of Science and Technology Policy 

Federal Coordinating Council for Science, Engineering, and Technology 



Committee on Physical, Mathematical, and Engineering Sciences 

Department of Agriculture 

Department of Commerce 

Department of Defense 

Department of Education 

Department of Energy 

Departmenl of Health and Human Services 

Department of hiterior 

Environmental Protection Agency 

National Aeronautics and Space Administration 

National Science Foundation 

Office of Management and Budget 

Office of Science and Technology Policy 



FCCSET Directorate 

Charles H. Dickens, Executive Secretary 
Elizabeth Rodriguez, Senior Policy Analyst 



High Performance Computing and Communications and Information Technology Subcommittee 



Name 



A gency or Department 



Donald A.B. Lindbcrg National Coordination 
Office 



James Burrows 

John S. Cavallini 
Melvyn Cimciii 

George Cotter 

Robin L. Dennis 



National Institute 
of Standards and 
Technology 

Department of Energy 

National Science 
Foundation 

National Security 
Agency 

linvironmcntal Protection 
Agency 



HPCCIT 
Subcommittee 

Chair 



Alternate 
Alternate 

Representative 

Alternate 



HPCCIT Executive 
Committee (see f). Hi) 

Chair 



Representative Representative 



Alternate 
Alternate 



ft 



Name 

Norman Click 

A. Nico Habermann 

(Dec coseih 

Lee Hoicomb 

Paul E, Hunter 

Steven Isakowitz 

Charles R. Kalina 

Norman H. Kreisman 
R.J. (Jerry) Linn 

Daniel R. Masys 

Bruce McConnell 

William L. McCoy 

James A. Mitchell 

David Nelson 
Michael R. Nelson 

Joan \\. Novak 



A gency or Department 

National Security 
Agency 

National Science 
Foundation 

National Aeronautics 
and Space 
Administration 

National Aeronautics 
and Space 
Administration 

Office of Management 
and Budget 

National Coordination 
Office 

Department of Energy 

National Institute 
of Standards and 
Technology 

National Institutes 
of Health 

Office of Management 
and Budget 

Federal Aviation 
Administration 

Department of 
Education 

Department of Energy 

Office of Science 
and Technt)iogy 
Policy 

F'nvironmental 
Protection Aizencv 



HPCCIT 
Subcommittee 

Alternate 



HPCCIT Executive 
Committee (seep. Hi) 



Representative Representative 
Representative Representative 

Alternate Alternate 

Representative 

Executive 
Secretary 

Alternate Alternate 
Alternate Alternate 

Representative 
Alternate 
Observer 
Representative 

R e pre se nt at i \ e R ( ^ pi'e se n t at i \ c 
Representative 

Representati\e 



ERLC 



Name 

Merrell Patrick 



Agency or Department 

National Science 
Foundation 



HPCCIT HPCCIT Executive 

Subcommittee Committee f.svc .s'oic hrhy 



Alternate 



Alternate 



Alex Poliakoff 



Thomas N. Pykc 



Department of 
Education 

National Oceanic 
and Atmospheric 
Administration 



Alternate 



Representative Representative 



John Silva 



Paul H. Smith 



Advanced Research Alternate 
Projects Agency 

National Aeronautics Alternate 

and Space 

Administration 



Alternate 



Alternate 



Stephen L, Squires 



John C, Toole 



Judith L, Vaitukaitis 



Advanced Research 
Projects Agency 

Advanced Research 
Projects Agency 

National Institutes 
of Health 



Alternate 



Alternate 



Representative Representative 



Alternate 



Noie: The Advanced Research Projects Af^etn y, the National Science Foundation, the Department and Eneri>\\ and 
the National Aeronautics and Space Administration hold permanent positions on the HPCCIT Executive Committee; 
the other two positions rotate cim(mi> the other ai>encies. 



Editorial Group for High Performance Computing and Communications 
1994 



Editor 

Sally E. Howe 

Assistant Director for Technical Pnff^ranis, Nationa' Coorditiation Office 



ERLC 



Program Component and Section Editors 

Melvyn Ciment, NSl\ Past Co-luiiior HPCC Program and Program Components 
Stephen GrilTin, NSf' Case Studies 

Daniel R. Masys, NIH Video 
Merrell Patrick, NSr BRIIR 



Calvin T. Ramos, NASA 
Stephen L. Squires* ARPA 
Roger Taylor, NSF 



ASTA 

HPCC Program, HPCS, IITA 
NREN 



Agency Editors 

Norman Click 
Stephen Griffin 
Frederick C. Johnson 
Thomas Kitchens 
Daniel R. Masys 
James A. Mitchell 
Joan H. Novak 
Thomas N. Pyke 
Calvin T. Ramos 
Stephen L. Squi •::s 



National Security Agency 

National Science Foundation 

National Institute of Standards and Technology 

Department of Energy 

National Institutes of Health 

Department of Education 

Environmental Protection Agency 

National Oceanic and Atmospheric Administration 

Nationa' Aeronautics and Space Aci.ninistration 

Advanced Research Projects Agency 



Copy Editor 

Patricia N. Williams 



National Coordination Office 



Acknowledgments 



In addition to the FCCSET, CPMES. HPCCIT Subcommittee, and Editorial Group, many other people 
contributed to this book, and we thank them for their efforts. We explicitly thank the following contribu- 
tors to the Component and Agency Sections: 

Robert Aiken, Lawrence Livermore National Laboratory, DOE 

Robin Dennis, EPA 

Darleen Fisher. NSF 

Michael St. Johns. USAF, ARPA 

Anthony Villasenor. NASA 



Contributors to the Case Studies are acknowledged at the end of the Case Studies section. 

We thank Joe Fitzgerald and Troy Hill of the Audiovisual Program Development Branch at the National 
Library of Medicine for their artistic contributions and for the preparation of the book in its final form, and 
we thank Patricia Carson and Shannon Uncangco of the National Coordination Office for their contribu- 
tions throughout the preparation of this book. 



ERLC 



iV 



Table of Contents 



L Executive Summary 



11. The HPCC Projirani 



Program Ovcr\ icw 
Program ManagemeiU 
Intcrdcpcndcncies Among Componcnls 
CoordiiuUion Among Agencies 
Membership on the HPCCIT Suhcommiuee 
Technology Collaboration with lndus(r\ and Academia 

7. Agency Budgets bs HPCC Components 

8. Agency Responsibilities by HPCC Components 



7 
15 
20 
21 

24 
25 
26 



III. HPCC Program Components 



1. Hiizh 

Performance Computing Systems 

2. National Research and Education Network 

3. Advanced Software Technology and Algorithms 

4- Information Infrastructure Technology and Applications 
5. Basic Research and Human Resources 



29 
32 
41 
47 
55 



IV. Individual Agency Programs 

1 . Advanced Research Projects Agency 

2. National Science Foundation 
3- Department of Energy 

4. National Aeronautics and Space Administration 

5. National Institutes of Health 

6. National Security AgencN 

7. National Institute of Standards and Technology 

8. National Oceanic and Atmospheric Administration 

9. En\'ironmental Protection Agency 

10. Department of Education 



59 
64 
72 
81 
87 
96 
101 
106 
111 
117 



V. Case Studies 



intfoduciion 



K Climate Modeling 

2. Sharing Remote Instruments 

3. Design and Simulation of Aerospace Vehicles 

4. High Perlormance Life Science: I tom Molecules to MRl 



119 

120 
123 
126 
129 



ERLC 



10 



ERIC 



Tabie of Contents 



(cont.) 



5. Non-Renewable Energy Resource Recover)' 139 

6. Groundwater Remediation 1 3^ 

7. Improving Environmental Decision Making 137 

8. Galaxy Formation 

9. Chaos Research and Applications J4j 

10. Virtual Reality Technology j43 

1 1. HPCC and Education 

12. GAMS: An Example of HPCC Community Resources 143 

13. Process Simulation and Modeling I^q 

14. Semiconductor Manufacturing for the 21st Century 152 

15. Advances Based on Field Programmable Gate Arrays 154 

16. High Performance Fortran and its Environment 155 

158 
159 
166 
173 



Contributing Writers 

VI. Glossary 

VII. Contacts 
IX. Index 



VI 



List of Tables 



HPCCIT (High Performance Computing. Communications, and 

Information Technology) Subcommittee 
Some Grand Challenge Problems 
Some National Challenge Application Areas 
Overview of the Five HPCC Components 
HPCC Program Goals 
HPCC Agencies 
HPCC Program Strategies 
HPCC Research Areas 

Major HPCC Conferences and Workshops During FY 1993 
HPCC-Related Conferences 
Evaluation Criteria for the HPCC Program 
Agency Budgets by HPCC Program Components 
Agency Responsibilities by HPCC Program Components 
Major Federal Components of the Interagency internet 
InterNIC Service Awards 
Gigabit Testbeds 

HPCC Agency Grand Challenge Research Teams 

Contrasts Between Grand Challenges and National Challenges 

NSF centers directly supported within the AST A component 

On- Going NSF Grand Challenge Applications Groups 

NSF Grand Challenge Applications Groups Initiated in FY 1993 

High performance systems under evaluation for biomedical applications 

NOAA Grand Challenges Requiring HPCC Resources 

NOAA Laboratories Involved in HPCC 

NOAA National Data Centers 



12 



List of Illustrations 



Schematic of interconnecied NSF. NASA, and DOE '"backbone" nct\s'orks 


NREN 


35 


High performance interconnect and fme-grained parallel systems board 


ARPA 


60 


Higii performance networking map 


ARPA 


61 


Modern operating systems schematic 


ARPA 


62 


National Challenges and Nil program layers schematic an i examples 


ARPA 


63 


NSF meiacenter hardware conllguration 


NSF 


64 


Industrial affiliates and partners at NSF Supercomputer Centers (pie chart) 


NSF 


65 


Mosaic screens 


NSF 


67 


Hydrogen/air turbulent reacting flame streams 


DOE 


72 


FSnet map 


DOE 


73 


Biochemically activated environmental chemical ben/o-a-j,yrene 


DOE 


74 


Parallel Virtual Machine (PVM) 


DOE 


75 


National Storage Laboratory (NSL) 


DOE 


76 


High School Science Students Honors Program ''Superkids" 


DOE 


77 


Volume renderings of density of bubble hit by shock wave 


DOE 


78 


Pacific Northwest Mesoscale Meteorological (MM) model results 


DOE 


79 


High velocity impact model results 


DOE 


80 


Simulation of the Earth's ozone layer 


NASA 


81 


Aeronautics Network (AERONet) map 


NASA 


82 


NASA Science Internet (NSINet) maps 


NASA 


82 


Simulated temperature profile for hypersonic re-entry body 


NASA 


83 


Simulation of surface pressure on High Speed Civil Transport (HSCT) 


NASA 


84 


Freestream airflow and engine exhaust of Harrier Vertical Takeoff 






and Landing (VTOL) aircraft 


NASA 


85 


Herpes simplex virus capsid cross-section reconstruction 


NIH 


87 


Myoglobin protein 


NIH 


89 


Bmdmg of small molecules to DNA 


NIH 


91 


Three-dimensional reconstruction from computed tomography and 






magnetic resonance images 


NIH 


92 


Four megabyte digital radiology image 


NIH 


93 


X-ray diffraction spectroscopy for determining protein structure 


NIH 


94 


Terasys workstation 


NSA 


96 


Graph of time improvements using multiple vs, single processor 


NSA 


97 


Memory traffic flow 


NSA 


98 


High Speed Network (HNET) Testbed 


NSA 


99 


Board employing Field Programmable Gate Arrays 


NSA 


100 


MultiKron chip 


NIST 


101 


Computer-controlled coordinate measuring machine 


NIST 


102 


Machine tool in the Shop of the 90s 


NIST 


103 


Cost-effective ways to help protect computerized data 


NIST 


104 


Statistical analysis of video microscope images 


NIST 


105 


Model of Colorado Front Range blizzard 


NOAA 


\m 


Contours of wind flow in middle atmosphere 


NOAA 


110 


EPA networking maps 


EPA 


ill 


Electric field vectors for benzopvrene 


E(V\ 


112 



viii • 

ERIC 



List of Illustrations (cont.) 



Regional Acid Deposition Model predictions of nitric acid over eastern U.S. 
Rendition of salinity in Chesapeake Bay 
Ozone concentrations through AVS interface 
Getting feedback on prototype user interface 

Fairfax County Public School teacher and students using PATHWAYS 

database and STAR SCHOOLS distance learning materials 
Simulation of speed of currents at ocean surface and global ocean model 
Sea surface temperature simulation maps 
Chick cerebellum - Purkinje cell 

Controlling high-voltage electron microscope over the Internet 
Simulation of airflow over and past high performance ai»':raft wing 
Airspeed contours around aircraft traveling at Mach 0.77 
Simulation of airflow through jet engine components 
Modeling of Purkinje neuron 

Computer-aided biopsy from magnetic resonance observation 
Molecular dynamics of leukotriene molecules portrayed using "ghosting" 
Gulf Coast Basin as described by geological database 
Comparison of computed injectivity of carbon dioxide and field data from 

Texas oil reservoir 
Groundwater remediation at Oak Ridge Waste Storage Facility 
Sediment transport in Lake Erie 

Astrophysical simulation of 8.8 million gravitational bodit^s 
Pattern found by "chaos" research 

Virtual reality environment for controlling scanning tunneling microscope 

Detail of virtual reality environment 

High school students using HPCC technologies 

DLA fractal object research for 1993 Westinghousc Science Talent Search 

Guide to Available Mathematical Softvv'are (GAMS) screen 

Simulation of liquid molding process for manufacturing polymer composite 

automotive body panels 
Simulation of current flow in bipolar transistor 
Splash 2 board containing Field Programmable Gate Arrays 
High Performance Fortran (HPF) code segments 



EPA 


113 


EPA 


114 


EPA 


115 


EPA 


1 16 


ED 


1 17 




118 
120 




123 




124 




126 




127 




128 




129 




130 




131 




132 




133 




135 




137 




139 




141 




143 




144 




145 




146 




148 




150 




152 




154 




157 



IX ^ ^ 



ERIC 



High Performance Computing and Communications: 
Toward a National Information Infrastructure 

The FY 1994 U.S. Research and Development Program 



Executive Summary 



The goal of the Federal High Perlomiance Computing and Communications (HPCC) Program is to 
accelerate the development of future generations of high performance computers and networks and the 
use of these resources in the Federal government and throughout the American economy. Scalable 
high performance computers, advanced high speed computer communications networks, and advanced 
software are critical components of a new National Information Infrastructure (Nil). This mfrastruc- 
ture is essential to our national competitiveness and will enable us to strengthen and improve the civ.l 
infrastructure, digital libraries, education and lifelong learning, energy management, the environment, 
health care, manufacturing processes and products, national security, and public access to government 
information. 

The HPCC Program evolved out of the recognition in the early 1980s by American scientists and engi- 
neers and leaders in government and industry that advanced computer and telecommunications tech- 
nologies could provide huge benefits throughout the research community and the entire U.S. economy. 
The Program is the result of several years of effort by senior government, industi-y, and academic sci- 
entists and manasers to initiate and implement a program to exte-:J U.S. leadership in hijh perfor- 
mance computing and networking technologies and to aoply those technologies to areas ol profound 
impact on and interest to the American people. 

The Program is planned, funded, and executed through the close cooperation of Federal agencies and 
laboratories, private industrv. and academia. These efforts are directed t(nvard ensuring that to the 
oreatest extent possible the Program meets the needs of all communities involved and that the results 
of the Program are brought into the research and educational communities and into the commercial 
marketplace as rapidly as possible. 

Now halfway through its five-year effort, the Program's considerable achievements include: 

-•More than a dozen high performance computing centers are in operation nationwide. New scal- 
able high performance systems are in operation at these centers, more advanced systems are in 
the pipeline, and new systems software is making these systems increasingly easy to use. 
Benchmark results improve ma.Kcdly with each new generation of hardware and software and 
bring the Program closer to its goal of achieving sustained terafiop (trillions of fioating point 
operations per second) performance. 
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j Traffic on federally-funded networks and the number of new local and regional networks 
necied to these networks continue to double every year. 



More than 6,000 re^uonaL state, and local IP (Internet Protocol) networks in the U.S., and more 
than 12,000 worldwide, are connected: more than 800 of the approximately 3,200 two-year and 
four-year colleges and universities in the Nation are interconnected; and an estimated 1,000 high 
schools also are connected to the Internet. Traffic on the NSFNET backbone has doubled o\^er 
the past year and has increased a hundred-fold since 1988. 

Already, HPCC research in the next generation of networking technologies indicates that the 
Program goal of sustained gigabit (billions of bits) per second transmission speeds will be 
achieved by no later than 1996. 



Teams of researchers have made substantial progress in adapting software applications for use 
on scalable high performance systems and are taking advantage of the increased computational 
throughput to solve problems of increasing resolution and complexity. 

Many of these problems arc "Grand Challenges," fundamental problems in science and engi- 
neering with broad economic and scientific impact whose solution can be advanced by applying 
high performance computing techniques and resources. These science and engineering Grand 
Challenge problems have motivated both the creation and the evolution of the HPCC Program. 
Solution of these problems is critical to the missions of several agencies participating in the 
Program. " ^ 



JT, J base ot researchers, educators, and students trained in using HPCC technologies has grown 
substantially as agencies have provided training in these technologies and in appiication'^areas 
that rely on them. 



The HPCC Program fully supports and is closely coordinated with the Administration's efforts to 
accelerate the development and deployment of the Nil. The Program and its participating agencies 
will help provide the basic research and technological development to support Nil implementation. 
To this end. several strategic and programmatic modifications have been made to the HPCC Program. 
The most significant of these is the addition of a new program component. Information Infrastructure 
Technology and Applications (IITA). 

HTA is a research and development effort that will enable the integration of critical information sys^ 
tems and their application to "National Challenge" problems. National Challenges are major societal 
needs that computing and communications technology can help address in key areas such as the civil 
infrastructure, digital libraries, education and lifelong learning, energy management, the environment, 
health care, manufacturing processes and products, national security, and public access to government 
information. The IITA component will develop and denionstrate prototype solutions to National 
Challenge problems. 



IITA lechnologies will support advanced applications such as: 



-J Routine transmission of an individual's medical record (including X-ray and CAT scan images) 
to a consulting physician located a thousand miles away. 

Jlhc study of books, films, music, photographs, and works of an in the Libraiy of Congress and 
in the Nation's great libraries, galleries, and museums on a regular basis by teachers and students 
anywhere in the country. 

J The Hexible incorporation ol' improved design and manufacturing to produce safer and more 
energy -efficient cars, airplanes, and homes. 

J Universal access by industry and the public to government data and information products. 



The five HPCC Program components and their key aspects are: 

High Performance Computing Systems (HPCS) 

-J Scalable computing systems, with associated software, including networks of heterogeneous 
systems ranging from affordable workstations to large scale high performance systems 

J Portable wireless interfaces 

National Research and Education Network (NREN) 

J Widened access by the research and education communities to high performance computing 
and research resources 

J Accelerated development and deployment of networking technologies 

Advanced Software Technology and Algorithms ( ASTA) 

J Prototype solutions to Grand Challenge problems through the development of advanced algo- 
rithms and software and the use of HPCC resources 

Information Infrastructure Technology and Applications (IITA) 

J Prototype solutions to National Challenge p»'oblems using HPCC enabling technologies 



Basic Research and Human Resources (BRHR) 

-J Support for research, training, and education in computer science, computer engineering, and 
computational science, and infrastructure enhancement through the addition of HPCC resources 

HPCC Program agencies work closely with industry and academia in developing, supporting, and 
using HPCC technology. In addition, industrial, academic, and professional societies provide critical 
analyses of the HPCC Program through conferences, workshops, and reports. Through these efforts, 
Program goals and accomplishments are better understood and Program planning and management are 
strengthened. 

The National Coordination Office (NCO) for High Performance Computing and Communications was 
established in September 1992 to provide a central focus for Program implementation. The Office 
coordinates the activities of participating agencies and organizations, and acts as a liaison to Congress, 
industry, academia, and the public. National Library of Medicine Director Donald A. B. Lindbcrg 
concuirently serves as Director of the NCO, in which capacity he reports directly to John H. Gibbons, 
the Assistant to the President for Science and Technology and the Director of the Office of Science 
and Technology Policy. 

In the past year, the National Security Agency, in the Department of Defense, and the Department of 
Education have joined the HPCC Program, bringing to 10 the number of participating agencies. The 
total FY 1993 HPCC budget for these 10 agencies is S805 million. For FY 1994, the proposed HPCC 
Program budget for the 10 agencies is $1,096 billion, representing a 36 percent increase over the 
appropriated FY 1993 level 

The HPCC Program is one of six multiagency programs under the Federal Coordinating Council for 
Science, Engineering, and Technology (FCCSET). The other five programs are Advanced 
Nianufacturing; Advanced Materials and Processing: Biotechnology Research; Global Change 
Research; and Science, Mathematics, Engineering, and Technology Education. Each of these depends 
on the capabilities provided by HPCC. 

The FY 1994 Program and this document are the products of the High Performance Computing, 
Communications, and Information Technology Subcommittee (HPCCIT) under the direction of the 
FCCSET Committee on Physical, Mathematical, and Engineering Sciences (CPMES). 
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Some Grand Challenge Problems 

Build more energy-efficient cars and airplanes 
Design better drugs 

Forecast weather and predict global climate change 
Improve environmental modeling 
Improve military systems 
Understand how galaxies are formed 
Understand the nature of new materials 
Understand the structure of biological molecules 





Some National Challenge Application Areas 
The civil infrastructure 
Digital libraries 

Education and lifelong learning 
Energy management 
The environment 
Health care 

Manufacturing processes and products 
National security 

Public access to government information 
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HPCC Program Overview 



High performance computing has become a critical tool for scientific and engineering research. In 
many fields, computational science and engineering have become as important as the traditional meth- 
ods of theory and experiment. This trend has been powered by computing hardware and software, 
computational methodologies and algorithms, availability and access to high performance computing 
systems, and the growth of a trained pool of scientists and engineers. 

The High Performance Computing and Communications (HPCC) Program has accelerated this 
progress through its investment in advanced research in computer and network communications hard- 
ware and software, national networks, and agency high performance computing centers. The 10 
Federal agencies that participate in the HPCC Program (listed on page 1 2), along with their partners in 
industry and academia. have made significant contributions to addressing critical areas of national 
interest to both the Federal government and the general public. 

High Perfonnance computing is knowledge and technology intensive. Its development and application 
span all scientific and engineering disciplines. Over the last 10 years, a new approach to computing 
has emerged that can support a broad range of needs ranging from workstations for individuals to the 
largest scale highest performance systems that are used as shared resources. The workstations may 
also be small scale parallel systems and connect by high performance networks into clusters. Through 
the combination of advanced computing and computer communication networks with associated soft- 
ware, these systems may be scaled over a wide performance range, may be heterogeneous, and may be 
shared over large geographic distances by interdisciplinary research communities. The largest scale 
parallel systems are referred to as massively parallel when hundreds, thousands, or more processors 
are involved. Networks of workstations provide access to shared computing resources consisting of 
other workstations and larger scale higher performance systems. 



High performance computing refers to the full range of supercom- 
put'ng activities including existing supercomputer systems, special 
purpose and experimental systems, and the new generation of large 
scale parallel architectures. 



A Research and Development Strategy 
for High Performance Computing 



Executive Office of the President 
Office of Science and Technology Policy 
November 20, 1987 
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The uses of and demand for advanced conipuler networking funded in part by the HPCC Program 
continue to expand. Progress and productivity in many fields of modern scientific and technical 
research rely on the close interaction of people located al distant sites, sharing and accessing computa- 
tional resources across high performance networks. Their use of networks has provided researchers 
with unexpected and unique capabilities and collaborations. As a result, the scientific community is 
dem.anding even higher performance from networks. This increased demand includes increasing num- 
bers of users; increasing usage by individual users: the need to iransmit more information at faster 
rates; more sophisticated applications; and the need for increased security, privacy, and the protection 
of intellectual property. 

The solution of "Grand Challenge" problems is a key part of the missions of many agencies in the 
HPCC Program, Grand Challenges are fundamental problems in science and engineering with broad 
economic and scientific impact whose solution can be advanced by applying high performance com- 
puting techniques and resources, The.se problems have and will continue to tax any available compu- 
tational and networking capabilities because of their demands for increased spatial and temporal reso- 
lution and increased model complexity. The fundamental physical sciences, engineering, and mathe- 
matical underpinnings are similar for many of the.se problems. To this end, a number of multiagency 
collaborations are underway. (Examples of these problems are identified in Some Grand Challenge 
Problems on page 5 and in HPCC Research Areas on page 14.) 

Although the U.S. remains the world leader in most of the critical areas of computing and computer 
communications technology, this lead is being threatened by countries that recognize the strategic 
nature of these technology developments. The HPCC Program leads the Federal investment in the 
frontiers of computing and computer communications technologies, formulated to satisfy national 
needs in .science and technology, the economy, human resources, and technology transfer. 

The HPCC Program will help provide the technological foundation for the National Information 
Infrastructure (Nil). The Nil will consist of computers and information appliances (including tele- 
phones and video displays), all containing computerized information, linked by high speed telecom- 
munication lines capable of transmitting billions of bits of information in a second (an entire encyclo- 
pedia in a few seconds). A Nation of users will be trained to use this technology. 

The computing and networking technology that will make the Nil possible is improving at an 
unprecedented rate, expanding its effectiveness and even further stimulating our imaginations about 
how it can be used. Using these technologies, a doctor who seeks a second opinion could transmit a 
patient's entire medical record - X-rays and ultrasound scans included - to a colleague thousands of 
miles away, in less time that it takes to send a fax today. A school child in a small town could come 
home and through a personal computer reach into an electronic Library of Congress or a great art 
gallery or museum to view thousands of books, photographs, records, videos, and works of art, all 
stored electronically. At home, viewers could use equivalent commercial services to choose at any 
lime to view one of th )usands of films or segments of television programming. 

The Administration is committed to accelerating the development and deployment of the Nil, which 
the U.S. will need to compete in the 21st century. This infrastructure of "information superhighways" 
will revolutionize the way we work, learn, shop, and live, and will provide Americans the information 
they need, when they need it, and where they need it - whether in the form of text, images, sound, or 
video. It promises to have an even greater impact than the interstate highways or the telephone sys- 
tem. The Nil will be as ubiquitous as the telephone system, but will be able to carry information at 
least l,(K)() times faster, h will be able to transmit not only voice and fax, but will also provide hun- 
dreds of channels of interactive high-definition TV programming, teleconferencing, and access to 
huge volumes of information. 
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Thanks in part to the HPCC Program, this technology is already in use in many of our research labora- 
tories where it is transforming the way research is done. Scientists and engineers can access informa- 
tion from computer databases scattered throughout the country and use high performance computers 
and research equipment thousands of miles away. Perhaps most importantly, researchers can collabo- 
rate and share information and tools with colleagues across the country and around the world as easily 
as if they were in ihc same room. 

This same telecommunications and computing technology could soon be available to all Americans, 
provided there is adequate public and private investment and forward-looking government policies 
that promote its deployment and use. 

The Administration believes that the Federal government has several important roles to play in the 
development of this infrastructure, which will be built and operated primarily by the private sector. 
The HPCC Program is a key part of the Administration's strategy for the Nil. On February' 22, 1993, 
the President and the Vice President unveiled a Technology Initiative that outlined the five parts of the 
Administration's strategy for building the National Information Infrastructure: 



1. Implement the HPCC Program. 

This Program is helping develop the basic technology needed for the Nil. 



2. Develop Nil technologies. 

Through the new Information Infrastructure Technology and Applications (IITA) component of the 
HPCC Program, industry', universities, and Federal laboratories will collaborate to develop technolo- 
gies needed to improve effective use of the Nil. 

3. Fund networking pilot projects. 

The Federal government will provide funding for networking pilot projects through the National 
Telecommunications and Information Administration (NTIA) of the Department of Commerce, which 
currently plays a key role in developing Federal communications policy. NTIA will provide matching 
grants to states, school districts, libraries, and other non-profit entities to purchase the computers and 
network connections needed for distance learning and for linking into computer networks such as the 
Internet. These pilot projects will demonstrate the benefits of networking in the educational and 
lihrar>' communities In addition, to the extent that other agencies undertake networking pilot pro- 
jects, NTIA will coordinate such projects, as appropriate. 

4. Promote dissemination of Federal information. 

Every year, the Federal government spends billions of dollars collecting and processing information 
(e.g., economic data, environmental data, and technical information). Unfortunately, while much of 
this information is very valuable, many potential users either do not know that it exists or do not know 
how to access it. The Administration is committed to using new computer and networking technology 



to make this infoniiation more available to the taxpayers who paid for it. This will require consistent 
Federal information policies designed to ensure that Federal information is made available at a fair 
price to as many users as possible while encouraging the growth of the information industry. 

5. Reform telecommunications policies. 

Government telecommunications policy has not kept pace with new developments in telecommunica- 
tions and computer technology. As a result, government regulations have tended to inhibit competi- 
tion and delay deployment of new technology and services. Without a consistent, stable regulatory 
environment, the private sector will hesitate to make the investments necessary to build the high speed 
national telecommunications network that this country needs to compete successfully in the 21st cen- 
tury. To address this and other problems, the Administration has created a White House-level intera- 
gency Information Infrastructure Task Force that will work with Congress, the private sector, and state 
and local governments to reach consensus on and implement policy changes needed to accelerate 
deployment of the Nil. 

Alihough the HPCC Program began as a research and development program, its impact is already 
being felt far beyond the research and education communities. The high performance computing tech- 
nology developed under this Program has alluwed users to improve understanding of global warming, 
discover more effective and safer drugs, design safer and more fuel-efficient cars and aircraft, and 
access huge "digital libraries" of information. The high sp-" networking technology developed and 
demonstrated by the HPCC Program has accelerated the growtn of the Internet computer network and 
enabled millions of users not just to exchange electronic mail, but to access computers, digital 
libraries, and research equipment around the world. This technology, which allows Internet users to 
hold a video conference from their desks, is enabling researchers across the countr>' to collaborate as 
effectively as if they were in the same room. The new IITA component of the HPCC Program will 
accelerate the deployment of HPCC technology into the marketplace and ensure that all Americans 
can enjoy its benefits. 

Federal investment in new technologies is one of the best investments the government can make, one 
that will provide huge, long-term benefits in terms of new jobs, better health care, better education, 
and a higher standard of living. This is particularly true in the case of the National Information 
Infrastructure, which will provide benefits to all sectors of our economy. Few initiatives offer as 
many potential benefits to all Americans. 

Several strategic and programmatic modiHcations have been made to the HPCC Program in order to 
enable the Nil Initiative to build on the Program's original four components. The most significant of 
these is the addition of the new IITA program component. IITA consists of research and development 
to enable the integration of critical information systems and the application of these systems to 
"National Challenges," problems where the application of HPCC technology can provide huge bene- 
fits to all Americans. 

These efforts will develop and appl> high performance computing and communications technologies 
to improve information systems for National Challenges such as the civil infrastructure, digital 
libraries, education and lifelong learning, energy management, the environment, health care, manufac- 
turing processes and products, national security, and public access to government information. 
Working with industry. IITA will support the development of the Nil and the development of the 
computer, network, and database technology needed to provide appropriate privacy anO security pro 
tection for users. 



Overview of the Five HPCC Components 



Five equally important, integrated components represent the key areas of high performance computing 
and communications: 



HPCS - High Performance Computing Systems 

Extend U.S. technological leadership in high performance computing through the development of 
scalable computing systems, with associated software, capable of sustaining at least one trillion opera- 
tions per second (teraops) performance. Scalable parallel and distributed computing systems will be 
able to support the full range of usage from workstations through the largest scale highest perfor- 
mance systems. Workstations will extend into portable wireless interfaces as technology advances. 



NREN - National Research and Education Network 

Extend U.S. technological leadership in computer communications by a program of research and 
development that advances the leading edge of networking technology and services. NREN will 
widen the research and education community's access to high performance computing and research 
centers and to electronic information resources and libraries. This will accelerate the development 
and deployment of networking technologies by the telecommunications industry. It includes nation- 
wide prototypes for terrestrial, satellite, wireless, and wireline communications systems, including 
fiber optics, with common protocol support and applications interfaces. 



ASTA - Advanced Software Technology and Algorithms 

Demonstrate prototype solutions to Grand Challenge problems through the development of advanced 
algorithms and software and the use of HPCC resources. Grand Challenge problems are computation- 
ally intensive problems such as forecasting weather, predicting climate, improving environmental 
monitoring, building more energy-efficient cars and airplanes, designing better drugs, and conducting 
basic scientific research. 



IITA - Information Infrastructure Technology and Applications 

Demonstrate prototype solutions to National Challenge problems using HPCC enabling technologies. 
IITA will support integrated systems technology demonstration projects for critical National 
Challenge applications through development of intelligent systems interfaces. These will include sys- 
tems development environments with support for virtual reality, image understanding, language and 
speech understanding, and data and object bases for electronic libraries and commerce. 



BRHR - Basic Research and Human Resources 

Support research, training, and education in computer science, computer engineering, and computa- 
tional science, and enhance the infrastructure through the addition of HPCC resources. Initiation of 
pilot projects for K-12 and lifelong learning will support expansion of the Nil. 
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HPCC Program Goals 

Extend U.S. technological leadership in high performance comput- 
ing and computer communications. 

Provide wide dissemination and application of the technologies to 
speed the pace of innovation and to improve the national economic 
competitiveness, national security, education, health care, and the 
global environment 

Provide key parts of the foundation for the National Information 
Infrastructure (Nil) and demonstrate selected Nil applications. 



HPCC Agencies 

ARPA - Advanced Research Projects Agency, Department of Defense 

DOE - Department of Energy 

ED - Department of Education 

EPA - Environmental Protection Agency 

NASA ~ National Aeronautics and Space Administration 

NIH - National Institutes of Health, Department of Health and 
f'uman Services 

NIST- National Institute of Standards and Technology, Department 
of Commerce 

NOAA - National Oceanic and Atmospheric Administration, 
Department of Commerce 

NSA - National Security Agency, Department of Defense 

NSF - National Science Foundation 
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HPCC Program Strategies 



Develop, through industrial collaboratiofiy high performance comput- 
ing systems using scalable parallel designs and technologies capable of 
sustaining at least one trillion operations per second (teraops) perfor- 
mance on large scientific and engineering problems such as Grand 
Challenges. 

Support all HPCC components by helping to expand and upgrade the 
Internet. 

Develop the networking technology required for deployment of nation- 
wide gigabit speed networks through collaboration with industry. 

Demonstrate the productiveness of wide area gigabit networking to sup- 
port and enhance Grand Challenge applications collaborations. 

Demonstrate prototype solutions of Grand Challenge problems that 
achieve and exploit teraops perfortnance. 

Provide and encourage innovation in the use of high performance com- 
puting systems and network access technologies for solving Grand 
Challenge and other applications by establishing collaborations to pro- 
vide and improve emerging software and algorithms. 

Create an infrastructure^ including high performance computing 
research centers^ networks^ and collaborations that encourage the dif- 
fusion and use of high performance computing and communications 
technologies in U.S. research and industrial applications. 

Work with industry to develop information infrastructure technology to 
support the National Information Infrastructure. 

Leverage the HPCC investment by working with industry to implement 
National Challenge applications. 

Enhance computational science as a widely recognized discipline for 
basic research by establishing nationally recognized and accepted edu- 
cational programs in computational science at the pre-college^ under- 
graduate^ and postgraduate levels. 

Increase the number of graduate and postdoctoral fellowships in com- 
puter science^ computer engineering, computational science and engi- 
neering, and informatics, and initiate undergraduate computational 
sciences scholarships and fellowships. 
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HPCC Research Areas 

•Aerospace 

- Aircraft 

- Spacecraft 

• Basic Science add Technology 

- Astronomy 

- Computers and network communications 

- Earth sciences 

- Molecular, atomic^ and nuclear structure 

- The nature of new materials 

• Education 

• Energy 

- Combustion systems (in automobile enginesyfor example) 

- Energy-efficient buildings 

•Environment 

- Pollution 

~ Weather, climate, and global change prediction and modeling 

•Health 

- Biological molecules 

- Improved drugs 

• Library and Information Science 

• Manufacturing 

• Military Systems and National Security Systems 
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HPCC Program Management 



The HPCC Program is planned, funded, and executed with the close cooperation of Federal agencies 
and laboratories, private industr)', and academia. These efforts are directed toward ensuring that to the 
greatest extent possible the Program meets the needs of all communities involved and that the results 
of the Program are brought into the research and educational communities and into the commercial 
marketplace as rapidly as possible. 

The National Coordination Office (NCO) for High Performance Computing and Communications was 
established in September 1992. Donald A. B. Lindberg was selected to direct the NCO, while continu- 
ing to sen-e as Director of the National Library of Medicine. The NCO coordinates the activities of 
participating agencies and organizations, and serves as a liaison to Congress, industry, academia, and 
the public. 

As Director of the NCO, Lindberg reports to John H. Gibbons, the Assistant to the President for 
Science and Technology and the Director of the Office of Science and Technology Policy. The 
Director of the NCO also chairs the CPMES High Performance Computing, Communications, and 
Information Technology (HPCCIT) Subcommittee. The Subcommittee meets regularly to coordinate 
agency HPCC programs through information exchanges, the common development of interagency 
programs, and the re\ iew of individual agency plans and budgets. It is also informed by presentations 
by other Federal working groups and by public bodies. 

Several HPCCIT working groups coordinate activities in specific areas. Individual agencies are 
responsible for coordinating these efforts: 

-•The Communications group, led by NSF, coordinates network integration activities and works 
closely with the Federal Networking Council (FNC). The FNC consists of representatives from 
interested Federal agencies, coordinates the efforts of govemmcn^ HPCC participants and other 
NREN constituents, and provides liaison to others interested in the Federal Program. 

J The Applications group, led by NASA, coordinates activities related to Grand Challenge applica- 
tions, software tools needed for applications development, and software development at high per- 
formance computing centers. 

-•The Research group, led by ARPA, focuses on basic research, technology trends, and alternative 
approaches to address the technological limits of information technology. Its activities are inte- 
grated into the overall research program through meetings with the various technical communi- 
ties. 

-•The Education group, led by NIH, coordinates HPCC education and training activities and pro- 
\ ides liaison with other education-related efforts under FCCSET. 

A Federal Networking Advisory Committee (FNCAC) supports the FNC by providing input and rec- 
ommendations from broad communities and constituencies of the NREN effort. Pursuant to P.L. 102- 
194, the High Performance C(miputing Act of 1991, a High Performance Computing Advisory 
Committee will be established to support Ihc o\erall HPCC Program. The Committee will improve 
communications and collaborations with T.S. industry, universities, state and local governments, and 
the public. 
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Each participating agency has foc^I points for addressing matters related to the HPCC Program. 
Organizational and management structures facililating participation in the HPCC Program are 
described in the sections presenting individual agency programs. Many participating agencies have 
published documents about their HPCC programs and solicitations for research in HPCC areas; 
requests should be directed to the respective HPCC contacts listed at the end of this document, 

U.S. industry, academia, and other developers and users of HPCC technology are involved in agency 
program planning and execution through advisory committees, commissioned reviews, self-generated 
commentary, and through direct participation in HPCC research and development efforts and as sup- 
pliers of technology. 



The HPCC Program has benefited from the interest, advice, and specific recommendations of a vari- 
ety of governmental, industrial, academic, professional, trade, and other organizations. These 
include: 

-J Federal organizations 

- Commerce, Energy, NASA, NLM, Defense Information (CENDI) Group 

- Congressional Re.search Service (CRS) 

- Department of Commerce HPCC Coordinating Group 

- Department of Health and Human Services Agency Heads 

- Federal Aviation Administration (FAA) 

- Federal Information Resources Management Policy Council (FIRMPOC) 

- Federal Library and Information Center Committee (FLICC) Forum on Information Policies 

- Food and Drug Administration (FDA) Center for Drug Evaluation and Research 

- Hou.se Armed Services Committee Staff 

- House Subcommittee on Science; Committee on Science, Space, and Technology 

- House Subcommittee on Technology, Environment, and Aviation; Committee on Science, 

Space, and Technology 

- House Subcommittee on Telecommunications and Finance; Committee on Energy and 

Commerce 

- NASA Advisory Council 

- National Telecommunications and information Administration (NTIA) 

- NIH Information Resources Management Council 

- Securities and Exchange Commi.ssion (SEC) 

- Senate Science Subcommittee; Committee on Commerce. Science, and Transportation 

-J Federally-chartered institutions 

- National Academy of Sciences (NAS)/Computer Science and Technology Board (CSTB) 

- NAS/CSTB/NRENaissance Study Group 

- NAS/Institute of Medicine 

- NAS/National Research Council (NRC) Executive Board 

State organizations 

- Texas Education Network 

- Wisconsin Ginemor's Council for Science and Technology 
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-» University organizations 

- Computing Research Association (CR A) 
- EDUCOM 

-J Professional societies 

- American Association of Engineering Societies (AAES) 

- American College of Cardiologists 

- American Institute of Medical and Biological Engineering ( AIMBE) 

- Association of American Medical Colleges 

- Coalition of Academic Supercomputer Centers (CASC) 

- Computer Professionals for Social Responsibility (CPSR) 

- International Medical Informatics Association (IMIA) 

-J Industrial organizations 

- American Electronics Association (AEA) 

- Computer Systeins Policy Project (CSPP) 

- Information Industry Association (IIA) 

-I Local organizations 

- Montgomery County High Technology Council 

- The Suburban Mar^'land Technology Council 

-I Other organizations with interest in HPCC 

- Coalition for Networked Information (CNI) 

- Foundation for Educational Innovation 

- Microelectronics and Computer Technology Corporation (MCC) 

- Science, Technology, and Public Policy Program 

John F. Kennedy School of Government, Harvard University 

- Supercomputing Center Directors 

-I Representatives from individual corporations, publishers, research laboratories, and supercom- 
puting centers 

-1 Foreign governments and organizations, including the British and Canadian governments 



The HPCC Program has sponsored several major conferences and workshops. HPCC representati\ i 
have given presentations at a number of related conferences as well. These are itemized below. 



Major HPCC Conferences and Workshops During FY 1993 


Event 


Sponsor 


High Performance Computing Industry 
Presentations 


NASA 


Improving Medical Care: Vision ofHPCCIT 


National Library 
of Medicine 


HPCC Applications in Chemistry 


NIH 


HPCC Comprehensive Review 


NASA 


Blue Ribbon Panel on HPCC 


NSF 


Workshop and Conference on Grand Challenge 
Applications and Software Technology 


Nine HPCC 
Agencies 



HPCC-Related Conferences 

American Institute of Medical and Biological Engineering 1993 
Annual Meeting 

Coordinating Federal Health Care: Progress and Promise 
Workshop 

Council on Competitiveness - Forum on Information Infrastructure 

Electronic Industries Association Fifth Annual Federal Information 
Systems Conference 

Georgetown University Medical School Computer Health Care 
Conference 
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HPCC'Related Conferences (conL) 

Institute of Electrical and Electronics Engineers (IEEE) 
Information Exchange Conference 

International Council for Scientific and Technical Information 
(ICSTI) Annual Meeting 

Nil Round Table sponsored by 3Com Corporation 

Research Consortium Inc, (RCI) North American Annual Member 
Executive Conference 

Scientific Computing and Automation Conference 
Supercomputing '92 
3Com Interop Conference 

Wide Area Information Services (WAIS) Conference 



The dynamism and tlexibiliiy of the HPCC Program is illustrated by the incorporation of many of 
these recommendations into current Program plans. For example, the CSPP conducted its second 
intensive study of the HPCC Program structure and in January 1993 published "Perspectives on the 
National Information Infrastructure: CSPP's Vision and Recommendations for Action." Many of 
their recommendations formed the basis for plans in the HPCC Program's new IITA component. 
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Interdependencies Among Components 



A complex web of inierdepcndcncies exists among the five components of the HPCC Program: suc- 
cess in each component is critical to the success of the others. Because of these interdependencies, 
maintaining balance among the components is crucial for Program success. The current balance is 
designed to foster thai success as rapidly as possible. Some examples of the large number of interde- 
pendencies are given below. 



Examples of two-component interdependencies: 

HPCS and NREN - The development of routers for the NREN component and other advanced com- 
ponent technologies depend on HPCS research in scalable computing and component 
technologies. 

HPCS and ASTA - The advanced computing systems with associated systems software are used by 
ASTA for Grand Challenge research. 

HPCS and IITA - HPCS systems are used by IITA for National Challenge research. 

NREN and ASTA - ASTA's Grand Challenge research helps to determine requirements for high 
performance networks for which NREN must provide new capabilities and technologies. 
Examples are distributed heterogeneous computing, scientific visualization, and the NSF 
metacenter research efforts. 

NREN and IITA - NREN provides the networking technology base for IITA. An example is 
interactive video. 



One example of a three-component interdependency: 

HPCS, NREN, ASTA - Networks developed under the NREN component are used to access 
lestbeds developed under the HPCS component in ASTA Grand Challenge research. 



An example of a four-component interdependency: 

HPCS, NREN, ASTA. IITA - Some computationall) intensive IITA applications will use systems 
developed under the HPCS component, connected by NREN-developed networks, and 
Grand Challenge software developed under ASTA. An example is managing emergen- 
cies such as hurricanes. 



Two five-component interdependencies: 

BRHR dependencies ~ BRHR depends on each of the other components, both individually and in 
combination, for research subjects. 

BRHR provides training and education in the four other components and their interrelationships. 



Coordination Among Agencies 



The participating agencies cooperate extensively in their efforts toward accomplishing HPCC 
Program goals, in part through the management vehicles described earlier and through the use of 
HPCC products from those other agencies wherever feasible. There are many other collaborations, 
including: 



-» Evaluation of early systems - these systems are procured primarily by NSF, DOE, and NASA: 
together with NIH. NSA, NOAA, and EPA, they are evaluated for mission-specific computa- 
tional and information processing applications. 

•J DOE and NASA are coordinating tcstbed development to ensure that a diverse set of computing 
systems are evaluated. 

^NIST is developing guidelines for measuring system performance, performance measurement 
tools, and software needed to monitor and improve the performance of advanced computing sys- 
tems at HPCC-sponsored high performance computing centers. 

-^The gigabit testheds (described on pages 37-39 in the NREN section). 

-1 High speed networking experiments - ARPA, NASA, and NSA collaborate. 

-» Network security - ARPA, NSA, NIST, and other agencies collaborate. 

J The NSF Supercomputer Centers. Other agencies jointly support and use these environments 
for their own missions and constituencies. One e>cample is the NIH Biomedical Research 
Technology program in biomedical computing applications. 

J The Concurrent SuperComputing Consortium (described on page 44 in the ASTA section). 

J The National Consortium for High Performance Computing established by ARPA in coopera- 
tion with NSF (described on pages 44-45 in the ASTA section). 

J The High Performance Software Sharing Exchange uses ARPA's wide area file system, NASA's 
distributed access to electronic data, and software repositories from DOE and NIST. These 
repositories are accessed by the other agencies. 

-J Joint agency workshops (for example, the recent "Workshop and Conference on Grand 
Challenge Applications and Software Technology"). 

J Representation on research proposal review panels (for example, DOE uses other agency experts 
in its Grand Challenge Review Committee). 
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Membership on the HPCCIT 
Subcommittee 



The National Coordination Oftlce and the HPCCIT Subcommittee actively encourage other Federal 
agencies (Departments, agencies within Departments, or independent agencies) to consider joining 
HPCCIT either as Official Members or as Observers. 

Ofticial Membership 

If an agency proposes a program and the HPCCIT Subcommittee determines that the program meets 
the Evaluation Criteria (see below) and approves it, then the Subcommittee will recommend to the 
Committee on Physical, Mathematical, and Engineering Sciences (CPMES) that the agency be added 
to the HPCC Program and participate in the budget crosscut. 

Observer Status 

Upon request from the agency and approval by the HPCCIT Subcommittee, an agency may participate 
in the technical program and attend HPCCIT Subcommittee meetings. 



Requests for membership or observer status should be directed to the National Coordination Office 
(listed on page 166 in the Contacts section). 



Evaluation Criteria for the HPCC Program 

Relevance/Contribution. The research must significantly contribute to the over- 
all goals and strategy of the Federal High Perfomiance Computing and 
Communications (HPCC) Program, including comput'ng, softwarey networking, 
information infrastructure, and basic research, to enable solution of the Grand 
Challenges and the National Challenges. 

Technical/Scientific Merit. The proposed agency program must be 
technically/scientifically sound and of high quality, and must be the product of a 
documented technical/scientific planning and review process. 

Readiness. A clear agency planning process must be evident, and the organiza- 
tion must have demonstrated capability to carry out the program. 

Timeliness. The proposed work must he technically/scientifically timely for one 
or more of the HPCC Program components. 
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Linkages. The responsible organization must have established policies, pro- 
grams, and activities promoting effective technical and scientific connections 
among government, industry, and academic sectors. 

Costs. The identified resources must be adequate, represent an appropriate 
share of the total available HPCC resources (e.g., a balance among program 
components), promote prospects for joint funding, and address long-term 
resource implications. 

Agency Approval. The proposed program or activity^ must Itave policy-level 
approval by the submitting agency. 
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Technology Collaboration with 
Industry and Academia 

HPCC agencies work in partnership with each other and industry and academia to develop cost-effec- 
tive high performance computing and communications technologies. The HPCC Program fosters the 
development and use of advanced off-the-shelf technology so that research results and products are 
simultaneously available to support both Federal agency missions and the computational needs of the 
academic and private sectors. 

HPCC research is carried out in close collaboration with industry, particularly manufacturers of com- 
puter and communications hardware, software developers, and representatives from key applications 
areas. A number of n ochanisms are used to facilitate these interactions: consortia, contracts, cooper- 
ative agreements mkI. as Cooperative Research and Development Agreements (CRADAs), grants, and 
other transactions. Some examples of these collaborations are: 

-»The gigabit testbeds (described on pages 37-39 in the NREN section). 

-I The Concurrent SuperComputing Consortium (described on page 44 in the ASTA section). 

->The National Consortium for High Performance Computing established by ARPA in coopera- 
tion with NSF (described on pages 44-45 in the ASTA section). 

-iNSFs National Supercomputer Centers and Science and Technology Centers and their metacen- 
ter efforts (described on page 66 in the NSF section). 

-I The Computational Aerosciences Consortium (described on page 85 in the NASA section). 

-•The Consortium on Advanced Modeling of Regional Air Quality (CAMRAQ) (described on 
pages 45-46 in the ASTA section). 



The National Coordination Office for High Performance Computing and Communications meets with 
representatives from industry and academia. Major HPCC conferences and workshops held by HPCC 
agencies or addressing HPCC issues have included a number of representatives from industry and 
academia as well. Further details about these activities are presented in the Program Management sec- 



tion 
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Agency Budgets by HPCC Program 
Components 



FY 1993 Budget (Dollars in Millions) 



Agency 


HPCS 


NREN 


ASTA 


BRHR 


TOTAL 


ARPA 


1 19.5 


43.6 


49.7 


62.2 


275.0 


NSF 


25.9 


40.5 


108.0 


50.8 


225.2 


DOE 


10.9 


1 0.0 


65.3 


14.8 


101.0 


NASA 


1 l.I 


9.0 


59.1 


2.9 


82.1 


NIH 


3.0 


4.1 


31.4 


8.0 


46.5 


NSA 


34.8 


3.2 


5.4 


0.2 


43.6 


NOAA 




0.4 


9.4 




9.8 


EPA 




0.4 


6.0 


1.5 


7.9 


NIST 


0.3 


1.2 


0.6 




2.1 


ED 




2.0 






2.0 


TOTAL 


205.5 


114.4 


334.9 


140.4 


795.2 



FY 1994 Budget (Dollars in Millions) 



Agency 


HPCS 


NREN 


ASTA 


IITA 


BRHR 


TOTAL 


ARPA 


151.8 


60.8 


58.7 




71.7 


343.0 


NSF 


34.2 


57.6 


140.0 


36.0 


73.2 


341.0 


DOE 


10.9 


16.8 


75.1 




21.0 


123.8 


NASA 


20.1 


13.2 


74.2 


12.0 


3.5 


123.0 


NIH 


6.5 


6.1 


26.2 


24.0 


8.3 


71.1 


NSA 


22.7 


1 1.2 


7.6 




0.2 


41.7 


NIST 


0.3 


1.2 


0.6 


24.0 




26.1 


NOAA 




1.6 


10.5 




0.3 


12.4 


EPA 




0.7 


9.6 




1.6 


11.9 


ED 




2.0 








2.0 


TOTAL 


246.5 


171.2 


402.5 


96.0 


179.8 


1,096.0 
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High Performance Computing Systems 
(HPCS) 

The HPCS component produces scalable parallel computing systems in collaboration wi!h industry 
and academia. Unlike dedicated, single processor architectures of the past, scalable parallel systems 
have the property that increases in size result in proportional improvement in performance. This is 
achieved by connecting multiple processors and memory units through a scalable interconnection 
structure. Scalable systems can be configured over a wide range that can deliver high performance 
computing to users at both small and very large scales. 

Because the computing system designs are scalable, they can be used in smaller scale workstations. 
Such workstations may also have high performance graphics capabilities to enable visualization of a 
computational result and provide interactive interfaces to the user. These workstations may be linked 
to local networks connected to the Internet, a network of networks that includes high performance sub- 
nets linking higher performance and larger scale computing systems throughout the country. 

HPCS focuses on the fundamental scientific and technological challenges of accelerating the advance 
of affordable scalable parallel high performance computing systems. Critical underlying technologies 
are developed in prototype form along with associated design tools. This allows evaluation of alterna- 
tives as the prototype systems mature. Evaluation continues throughout the research and development 
process, with experimental results used to refine successive generations of systems. 

Scalable computing technologies used in combination with scalable networking technologies provide 
the technology base needed to address the Grand Challenges and the National Challenges. The neces- 
sary software technologies are developed by the ASTA and IITA components. 



HPCS is composed of four elements to produce progressively more advanced and mature systems: 
1. Research for Future Generations of Computing Systems 

This element develops the underlying architecture, components, packaging (integration of electronics, 
photonics, power, cooling, and other components), systems software, and scaling concepts to achie%e 
affordable high performance computing systems. These efforts ensure that the required advanced 
technologies will be available for the new systems and provide a foundation for the more powerful 
systems to follow. This element also produces the basic approaches for systems software, program- 
ming languages, and environments for heterogeneous configurations of workstations and high perfor- 
mance servers. 

li. System Design Tools 

This element develops computer aided design tools and the technology to allow multiple design tools 
to work together in order to enable the design, analysis, simulation, and testing of system components 
and modules. These tools make rapid prototyping of new system concepts possible. New design tools 
will be produced to enable the design of more ad%anced prototype systems using new technologies as 
they emerge. 
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III. Advanced Prototype Systems 

SysiLMiis capable of scaling to 100 gigaops (billions ofoperalions per second) performance have begun 
10 emerge. Teraops (iriliions of operations per second) performance designs will be demonstrated^ by 
the mid 199()s. Research in high performance systems focuses on reducing the cost and size of these 
sysleins so they can be used for a broader range of applications. 

IV. Evaluation of Early Systems 

Experimental systems will be placed at sites where researchers can provide feedback to systems and 
software designers. Performance evaluation criteria for systems and results of evaluations will be 
made widely available. Scalability enables small to medium size systems to be used for early perfor- 
mance evaluation and sol\\vare development in preparation for larger scale applications. Larger scale 
systems are included in the ASIA component fo;- applications such as the Grand Challenges. " 



HPCS Accomplishments 

-J Small, medium, and large scale systems developed under the HPCS component have been 
deployed and are being used in the a\STA component. This includes large systems deployed in 
various high performance computing centers and some systems installed in heterogeneous con- 
figurations. 

The small and medium scale systems are being used to develop algorithms and software, includ- 
ing fundamental building blocks for Grand Challenge problems and a wide variety of new scien- 
tific computation models. These prototypes are characterized by very fast routing and compo- 
nent technology, capable of scaling up to 100 gigaops system configurations. 
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-J Scalable systems continue to be evaluated and refined, providing early feedback on hardwan 
operating systems, compilers, software development tools, input/output systems, and mass stor- 
age systems. This process has resulted in rapid upgrades in a commercial system to a scalable 
operating system based on very small and efficient software called microkernel technology. 
Extensions such as real time services and distributed and replicated file systems are under devel- 
opment. 

-J New technologies are providing a scalable, modular approach to mass storage performance and 
archiving needed in the new large scale parallel computing systems: 

- Prototype scalable mass storage systems that use parallel arrays of inexpensive disk drives 
to achieve both high aggregate data transmission rates and large storage capacity have been 
demonstrated. These systems de^Monslrate an approach that is the basis for a new genera- 
lion of high performance llle servers and mass storage systems that are internal to scalable 
parallel computing systems. 

- Petabyte mass storage systems, which can hold images from about 50 university libraries, 
are now available using commodity storage modules with automated robotic transfer to 
multiple read/write units. These systems help meet the dramaticallv increasing require- 
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nicnls for mass sioiagc - from storing library information to storing remotely sensed satel- 
lite imagery. 

-I Evolving advanced component technology is being employed in early experimental computer 
systems. This technology will form the basis for a new generation of higher performance, physi- 
cally smaller, and more affordable computing systems. Examples include the following: 

- Single chip nodes that integrate processing, storage and communications, new systems soft- 
ware, and new development environments, have been demonstrated. These have the poten- 
tial of providing very cost-effective scalable computing using these single chip or fine 
grained nodes. 

- Mullichip modules are being studied in experiments to determine the optimal design for 
future scalable units. 

-I Supporting technologies that enable the rapid design, prototyping, and manufacturing of HPCS 
systems have made an important contribution to HPCS progress. Examples of rapid prototyping 
facilities used by researchers include: 

- A laser direct write multichip module tool and associated design capability, has been devel- 
oped to reduce the prototyping time oi' new modules from months to two weeks. This 
enables designs to be developed more rapidly, and allows for the exploration of more effec- 
tive and cost-effective alternatives, 

- New algorithms nave been incorporated into design systems that extend synthesis to be 
applied to new technologies such as field programmable gate airays and various integrated 
circuit technologies. 

- A model "factory of the future," linking advanced design technologies from workstations to 
large scalable computing, was completed and coupled to a prototype factory (described on 
pages 152-153 in the Case Studies section). These technologies form the basis of a new 
geneiation of computational prototyping, exploiting networked and distributed design pro- 
cesses for rapidly prototyping future generations. 

-I New competitive contractual mechanisms have been developed to enable the timeh' purchase of 
experimental systems. These joint government-industry research projects allow experimental 
use and early evaluation by a variety of user communities, which in turn pro\ ides early feedback 
to the hardware vendois and to dexelopers of associated software technology. Such projects 
accelerate the maturation of these complex technologies in preparation for their larger scale use 
by the ASTA component. 
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National Research and Education 
Network Program (NREN) 



The NREN* component will establish a gigabit communications infrastructure to enhance the ability 
of U.S. researchers and educators to perform collaborative research and education activities, regard- 
less of their physical location or local computational and information resources. This infrastructure 
will be an extension of thj Internet, and will serve as a catalyst foi the development of the high speed 
communications and information systems needed for the National Information Infrastructure (Nil). 

The emerging Nil will require: advances in the underlying foundations of networking technology and 
in generic networking services; the development and deployment of major new networking technolo- 
gies; broader access to state-of-the-art high performance computing facilities; and early testing of new 
commercial products and services so that these can be effectively integrated into NREN associated 
networks. 



The principal objectives of the NREN component are to: 

Establish and encourage wide use of gigabit networks by the research and education communi- 
ties to access high performance computing systems, research facilities, electronic information 
resources, and libraries. 

-I Develop advanced high performance networking technologies and accelerate their deployment 
and evaluation in research and education environments. 

-I Stimulate the wide availability at reasonable cost of advanced network products and services 
from the private sector for the general research and education communities. 

-^Cataly/.e the rapid deployment of a high ^pced general purpose digital communications infras- 
tructure for the Nation. 



The NREN component's Interagenc) Internet and Gigabit Research and Development elements con- 
tribute to reaching these goals: 

I. Interagency Internet 

Near-term enhanced network services will be developed on the Nation's evolving networking and 
telecommunications infrastructure for use by mission agencies and the research and education com- 
munities. Interagency Internet activities include expansion of the connectivity aud enhancement of 
the capabilities of the federally funded portion of today's research and education networks, and 
deployment of advanced high performance technologies and services as the) mature. Coordinated 
among Federal agencies in cooperation with the private sector, this effort succeeds the Interim 
Interagency NREN element identillcd in previous reports about the HPCC Program. 



• NSF has applied for rcgistrjUon of the service mark "NREN" iv///? //?e U.S. Patent and Trademark Office. 
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The Interagency Internet is a network of networks, ranging from high speed cross-country networks, 
to regional and mid-level networks, to state and campus network systems. Its major Federal compo- 
nents^ are the national research agency networks listed below. When these agencies' "backbone net- 
works" are upgraded, together they will form a national gigabit network to support research and edu- 
cation. This network may in turn serve as a prototype for broader national gigabit networks. 



Major Federal Components of the Interagency Internet 
NSFNET 

NSF-funded national backbone network setrice 
ESnet 

doe's Energy Sciences Network 

NSl 

NASA's Science Internet 
ARPA 's exploratory networks 



The Interagency Internet and the other, non-federally-supported, portions of the Internet connect the 
Nation's communities of researchers and educators to each other: to facilities and resources such as 
computation centers, databases, libraries, laboratories, ana scientific instruments: and to supporting 
organizations such as publishers and hardware and software vendors. The Interagency Internet also 
provides international connections that serve the national interest. These services will be continually 
enhanced as the Interagency Internet evolves. 

The Interagency Internet also provides a testbed to stimulate the market for advanced network tech- 
nologies such as Synchronous Optical Network (SONET) transmission infrastructure. Asynchronous 
Transfer Mode (ATM) cell switches, high speed routers, computer interfaces, and other communica- 
tions hardware and software. These technologies are being developed by the telecommunications 
industry, routing vendors, and computer manufacturers, in collaboration with government and 
academia, as part of the NREN component of the HPCC Program. Through these efforts, the HPCC 
agencies will provide expertise in the systems integration of key technologies to form an integrated 
and interoperable high performance network system that will continue to meet the needs of the 
Nation's research and education communities. Once the initial development risks are reduced through 
this collaboration among government, industry, and academia, the U.S. communications community 
can build on these experiences and develop new products and services to serve the broader market- 
place of Nil applications. 




IL Gigabit Research and Development 

The Gigabit Research and Development element is a comprehensive program to develop the funda- 
mental technologies needed for a national network with advanced capabilities and with a minimum 
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gigabit per second (Gb/s) transmission speed. Gigabit research and development takes place in two 
ways: through a basic research program that provides the building blocks to move data at increasingly 
faster rates with novel techniques such as all optical networking; and through the deployment of 
testbed networks that use and prove the viability of these techniques. The testbeds provide an envi- 
ronment for the de\ elopment of advanced applications targeted toward the solution of HPCC Grand 
Challenges. 

As these technologies for networking hardware and software are developed and shown to be viable 
and cost-effective, they will be incorporated into the Interagency Internet, They will also provide a 
foundation for supporting Grand and National Challenges and their further extension to the National 
Information Infrastructure. Building on this foundation, the government and industrial partners will 
develop prototypes for a future high capability commercial communications infrastructure for the 
Nation. 



NREN Component Management 

Each agency implements its own NREN activities through normal agency structures and coordination 
with 0MB and OSTP. All 10 agencies participate in the NREN component as users. Multiagency 
coordination is achieved through FCCSET, CPMES, HPCCIT, and the HPCCIT High Performance 
Communications working group. 

Operation of the Interagency Internet is coordinated by the Federal Networking Council (FNC), which 
consists of agency representatives. The FNC and its Executive Committee establish direction, provide 
further coordination, and address technical, operational, and management issues through working 
groups and ad hoc task forces. The FNC has established the Federal Networking Council Advisory 
Committee, which consists of representatives from several sectors including librar}' sciences, educa- 
tion, computers, telecommunications, information services, and routing vendors, to assure that pro- 
gram goals and objectives reflect the interests of these broad sectors. 



A ccomplish men ts 



Increased Connectivity and Use of the Interagency Internet 

The Interagency Internet has experienced tremendous growth in the number of connections (and hence 
the number of researchers) it supports, and in the amount of traffic that it carries. Significant leverag- 
ing of the Interagency Internet activities have resulted in the following: 

J More than 6,000 regional, state, and local IP (Internet Protocol) networks in the U.S. are con- 
nected as of March 1993. More than 12,000 such networks are connected worldwide. 

J More than 800 of the approximately 3,200 two-year and four-year colleges and universities in 
the Nation are interconnected, including all of the schools in the top two categories ("Research" 
and "Doctorate") of the Carnegie classification. 

J An estimated 1.000 U.S. high schools also are connected. The exact number is dilTiculi {o dcicr- 
mino since regional networks have widely leveraged NSF and other agency funds to connect 
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such institutions without direct agency involvement. For example, state initiatives in Texas and 
North Carolina proceed with little or no Federal funding or involvement. 

Traffic on the NSFNET backbone has doubled over the past year, and has increased a hundred-fold 
since 1988. Improvements and upgrades to the network made by NSF have kept pace with the 
increased traffic and have advanced the state of network technology and operations. 

ARPA, DOE, NASA, and NSF provide international connectivity to the Pacific Rim, Europe, Japan, 
United Kingdom, South America, China, and the former Soviet Union, for mission-specific scientific 
collaborations and general research and education infrastructure requirements. These links are of 
varying speeds, with many of the larger "fat pipes" cost-shared and co-managed by agencies requiring 
high speed connectivity. 




VI |:i V 



Schematic of the interconnected "backbone" networks of NSF, NASA, and DOE, together with selected client 
regional and other networks. The backbone topology is shown on a plane above the outline of the U.S. Line seg- 
ments connect backbone nodes with geographic locations where client networks attach. 



Procurement of Fast Packet Services 

The need for advanced networking <ser\ices has been driven by the requirements of distributed scien- 
tific visualization and remote experiment control, and more recently by the phenomenal growth of 
multimedia applications. In order to satisfy these needs, DOE and NASA are in the process of jointly 
acquiring fast packet services based on new telecommunications industry-provided services (for 
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example, ATM/SONET). The initial deployment will provide a 45 megabits per second (Mb/s) back- 
bone serv'ice; upgrades to higher speeds are planned as soon as technology and budgets permit. 

A key feature of this procurement is the use of as yet untariffed telecommunications provider services 
in an alpha test mode. In order to meet this procurement's deployment schedule, the telecommunica- 
tions industry has accelerated its prototyping and deployment plans. The IITA component of the 
HPCC Program will later use these technologies via commercial services from the telecommunica- 
tions industry and router vendor market. 

NASA and ARPA will use NAS.^ s geostationary Advanced Communications Technology Satellite 
(ACTS), launched in 1993, to provide even higher speed (for example, 622 Mb/s) ATM/SONET 
transmission to remote sites such as Alaska and Hawaii. The deployment will allow the HPCC agen- 
cies to gain experience in interfacing both terrestrial and satellite high speed communications systems. 
ARPA manages the development and deployment of the ACTS High Data Rate Terminals. 

Internet Network Information Center (InterNIC) 

In 1992, NSF issued a competitive solicitation for an Internet Network Information Center (InterNIC) 
to provide a variety of services to the worldwide Inlemel community. Awards were made to three 
organizations listed below to collaborate in providing these services. Information about how to con- 
nect to the Internet, pointers to network tools and resources, and seminars on various topics held 
across the country is available from the InterNIC Information Services (listed on page 167 in the 
Contacts section). 



InterNIC Service Awards 



Service 



Description 



Award Made To 



Information 



General infonnation 
about the Internet 
and how to use it 



General 

A tomics/CERFnet 



Directory 
and 

Database 



Coordinated directory 
of the growing number 
of resources available 
on the Internet 



AT&T 



Reguitration 



Registry of the growing 
number of networks 
connected to the Internet 



Network 
Solutions Inc. 
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Prompted by the recent development of network-based tools to seek out information by querying 
remote databases, NSF lias established a Clearinghouse for Networked Information Discovery and 
Retrieval tools for assembling, disseminating, and enhancing such pui/!icly available network tools. 
The clearinghouse complements the InterNIC. 

Solicitation of the Next Generation NSFNET 

Now that basic network services are readily and economically available commercially, NSFNET will, 
beginning in 1994, evolve into a very high speed national backbone for research applications requiring 
high bandwidth. In a new solicitation, NSF is requesting proposals to: 

-J Establish an unspecified number of Network Access Points (NAPs) where regional and other 
service providers will be able to exchange traffic and routing information. 

-J Establish a Routing Arbiter to ensure coherent and consistent routing of traffic among NAP par- 



Establish a very high speed Backbone Network Service (vBNS) linking the NSF-supported 
Supercomputing Centers. 

-J Allow existing or realigned regional networks to connect to NAPs or Network Service 
Providers, who would connect to NAPs, for interregional connectivity. 

The NAPs will provide connectivity to mid-level or regional networks serving both commercial and 
research and education customers and will also provide access to the vBNS. 

With respect to regional networks, this solicitation addresses only interregional connectivity. On- 
going complementary intraregional support will continue and will be funded at constant or rising lev- 
els. These efforts include the Connections Program, wiiich provides grants either to individual institu- 
tions or to more effective or more economical aggregates. A separate announcement to address 
intraregional connection of high-bandwidth users to the vBNS is planned for FY 1994. 

Interconnecting the NSF Supercomputer Centers, the vBNS will be part of the Interagency Internet. It 
is expected that the vBNS will run at a minimum speed of 155 Mb/s and that low speed connections to 
NAPs will be routed elsewhere. 



Gigabit Research Projects 

By 1996, gigabit research will lead to an experiinental nationwide network able to deli\ er speeds up to 
2.4 billion bits per second to individual end user applications. 

Ongoing research and development addresses communications protocols, resource allocation algo- 
rithms, network security systems, exploration of alternative network architectures, hardware and soft- 
ware, and the validation of that research by the deployment of several wide-area testbed networks. 
Several high data rate local area network testbeds will allow Federal agencies, industry, and academic 
researchers to explore innovative approaches to advanced applications such as global change research, 
computer imagery, and chip design. 



ticipants. 
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In 1990, ARPA and NSF jointly began sponsoriag five gigabit network research testbeds; all are 
expected to be operational by the end of 1993. The research at the five testbeds and at testbeds initiat- 
ed subsequently (e.g., MAGIC sponsored by ARPA), focuses on network technology and network 
applications, with alternative network architectures, implementations, and applications of special 
interest. 

Each testbed explores at least one aspect of high performance distributed computing and networking: 
together they seek to create and investigate a balanced high performance computing and communica- 
tions environment. 

Testbed teams consist of several government agencies (ARPA, DOE, Department of the interior, 
NASA, NSF, state centers, and supercomputer centers), a number of universities, computer compa- 
nies, and various local and long distance telephone companies that participate both as service 
providers and experimenters. 



Other Projects 

ARPA-sponsored consortia and individual projects are implementing novel networks that minimize or 
eliminate electronic content and replace it with optical technology. These efforts use alternative opti- 
cal schemes for data rates in excess of 10 Gb/s. Industry partnerships guarantee a rapid transition of 
the most promising technologies into the commercial sector. 

ARPA's Washington Area Bitway is a multiple-technology testbed in the Washington-Baltimore area 
that enables early experience with advanced network technologies. The first phase, called the 
Advanced Technology Demonstration Network (ATDnet) uses the best commercial prototypes of 
SONET/ ATM technology to provide lOOMb/s-lGb/s services to several DOD agencies and N.ASA, 
Applications include ACTS ground connections, imaging, and gigabit encryption. Later phases will 
demonstrate advanced optical technologies over the same optical fiber paths. 

Another ARPA demonstration project will show the utility of asymmetric rate/asymmetric path (Cable 
TV and dialup) network access. Planned for the San Francisco Bay Area and for the Washington, 
D.C. area, the project is designed to explore a relatively inexpensive alternative to satisfying the "last 
mile" - that is, connections to homes and businesses - in high speed networking implementations. 

NSF also supports Project ACORN, a collaborative research effort with an NSF Engineering Research 
Center and its industrial consortia, that is investigating lightwave networks of the 2 1st century. The 
project's TeraNet, a laborator)' implementation and feasibility demonstration, will lead to a campus- 
wide field experiment involving leading-edge users, NSF has also begun to suppon research in all- 
optical networks. 
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Gigabit Testbeds 










Sites 


Principal Research Participants 








and Collaborating 








Teiecommunications Carriers 


• 

Aurora 


txploro alt6rnauV6 nstwork 


Bellcore -- Morristown, NJ 


Bell Atlantic 




technologies, new network 


IBM - Hawthorne, NY 


Bellcore 




management and distributed system 


MIT - Cambridge, MA 


IBM 




paradigms, and Quality of service 


U. Pennsylvania - Philadelphia 


MCI 




techniques for gigabit network 




MIT 




multimedia applications. 




NYNEX 








U. Arizona 








U. Pennsylvania 




tiiWouyolc iiolWUlfS l/UiulUI, leal 


Lawrence Berkeley Laboratory (LBL) - 


Ameritech 




iimc pruiuculo, anu uibinuuicu 


Berkeley, CA 


Astronautics 




interactive applications including 


NCSA - Champaign-Urbana, IL 


AT&T 




remote thunderstonn visualization, 


U. California at Berkeley 


Bell Atlantic 




radio astronomy Imaging, and 


U. Illinois - Champaign-Urbana 


LBL 




multimedia digital libraries. 


U. Wisconsin at Madison 


iNCSA 








Pacific Bell 








U. California at Berkeley 








U. Illinois at Champaign-Urbana 








U. Wisconsin at Madison 


Casa* 


Investigate distn'outec! large-scale 


Callech - Pasadena, CA 


Caltech 




supercomputing over wide-area 


Jet Propulsion Laboratory (JPL) - Pasadena, 


JPL 




919^^'^ nciwurivo uoiii9 (^iiciiiioai 


CA 


LANL 




reacuon uynarniub, 9"uiv/9yi anu 


Los Alamos National Laboratory (LANL) 


MCI 




climate modeling applications. 


San Diego Supercomputer Center (SDSC) 


Pacific Ball 






UCLA 










UCLA 








USWest 


Nsctar* 


lilVooll9dlc oUilWalc aiiU iiilBI lal/iiiy 


Carnegie-Mellon U. (CMU) - Pittsburgh, PA 


Bell Atlantic/Bell of Pennsylvania 




cnvirunrricnid lur 9'9^^'^^^^"^ 


Pittsburgh Supercomputer Center (PSC) 


Bellcore 




heterogeneous computing and 




CMU 




explore chemical processing and 








combinatorial optimization 








appiiuciuund. 






% /IOTA 

VlSTANet 


....... 

Evaluate the application of gigabit 


BellSouth - Chapel Hill, NC 


BellSouth 




networks and distributed computing 


GTE - Durham, NC 


GTE 




techniques to interactive radiation 


MCNC (formerly Microelectronics Center of 


MCNC 




therapy medical treatment planning. 


North Carolina) - Research Triangle Park. 


North Carolina State U 




NC 


UNC-GH 






U. North Carolina at Chapel Hill (UNC-CH) 




MaQic 


Early demonstration of high speed 


Minnesota Supercomputer Center - 


Digital Equipment Corp. 




terrain visualization with longer 


Minneapolis 


DOE 




range plans to incorporate real-time 


U. of Kansas in Lawrence 


Earth Resources Observation 




sensor data into a real-time virtual 


U.S. Amiy's Future Battle Laboratory - Fort 


Systems Data Center 




world model and display. 


Leavenworth, KS 


LBL 






U.S. Geological Survey (USGS) - Sioux Falls, 


MITRE 






SD 


Minnesota Supercomputer Center 








Northern Telecom 








Split Rock Telecom 








Sprint 








Southwestern Bell 








SRI International 








U. Kansas 








U.S. Army High Performance 








Computing Research Center 








U.S. Army's Future Battle 








Laboratory 








USGS 



• Information summanzed from 'A Brief Descnption of the CNRI Gigabit Testbed Initiative." Corporation for National Resenrch Initiatives. 
1895 Prcstcn White Drive. Suite 100. Restcn. Virginia. 22091-5434. (703) 620-8990. 
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NREN FY 1994 Milestones 



Bring MAGIC tcstbcd into operation. Conduct initial terrain visualization demonstrations. 

Demonstrate prototypes of gigabit ATM/SONET technology operating over fiber and satellite 
(using ACTS) media. Install initial gigabit network interconnection. 

Bring all-optical testbed networks into operation. 

Put medical terrain visualization, and modeling applications on 100 megabit and gigabit class net- 
works. 

Complete BSnet and NSI fast packet upgrades. 

Beta test high speed LAN interconnects with ESnet's fast packet WAN services. 

Make awards to establish a series of NAPs, a Routing Arbiter, and a vBNS that links NSF super- 
computer sites and is accessible from the NAPs. 

Formulate programs and solicit proposals to support high bandwidth i^.pplications on the vBNS. 

Continue improvements in U.S. -to-international conncciiviiy. 
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Advanced Software TechnoEogy and 
Algorithms (ASTA) 



The purpose of the ASTA component is to develop the scalable paraiiel algorithms and software need- 
ed to realize the potential of the new high performance computing systems in solving Grand 
Challenge problems in science and engineering. The early experimental use of this software on the 
new systems accelerates their maturation and identifies and resolves scaling issues on the most chal- 
lenging problems. 

The principal objectives of the ASTA component are to: 

-J Demonstrate large-scale, multidisciplinary computational results on heterogeneous, distributed 
systems, using the Internet to access distributed file systems and national software libraries. 

Establish portable, scalable libraries that enable transition to the new scalable computing base 
across different systems and their continued advance through successive generations. 

Develop a suite of software tools that enhance productivity (e.g., debuggers, monitoring and par- 
allelization tools, run-time optimizers, load balancing tools, and data management and visualiza- 
tion tools). 

-•Promote broad industry involvement. 

The ASTA component is composed of four elements: 
L Support for Grand Challenges 

Prototype applications software will be developed to address computationally intensive problems such 
as the Grand Challenges. Solution of these problems is not only critical to the missions of agencies in 
the HPCC Program, but has broad applicability to the national technology base. Continuing increases 
in computational power enable researchers in government, industry, and academia to address prob- 
lems of greater magnitude and complexity. Increased computational power enables: 

More realistic models as a result of higher resolution computational models. An example is 
weather models that show features on a local or regional scale, not just on a continental or global 
scale. 

-> Reduced execution times. Models that took days of execution time now take hours, enabling the 
user to modify the input more frequently, perhaps interactively and graphically, thus gaining 
insight faster. Reduced execution times also enable modeling over longer time scales (for exam- 
ple, 100 year climate models can now be executed in the same time it used to take for 10 year 
models). 

-^More sophisticated models, including models fomierly too time consuming. The radiative prop- 
eilies of clouds can be included in climate models, for example. 

-• Lower C(^st solulii^ns to speciHc problems, resulting in availability to a larger user community. 



Multidisciplinary teams of computational scientists and disciplinary specialists from one or more 
Federal agencies and from industry and acadcmia are working together to address these problems. 
Many of these Grand Challenges projects are cofunded and cosponsored by industry. 

Significant progress has already been made toward solving many of these problems, and is expected to 
continue as the Program progresses. These new computational approaches are already being incorpo- 
rated by industry into new products, services, and industrial processes such as testing and manufactur- 
ing. 

II. Software Components and Tools 

A complete collection of software components and tools is essential for a mature scalable parallel 
computing environment that supports portable software. These software components and tools must 
include standard higher level languages; advanced compilers; tools for performance measurement, 
optimization and parallelization, debugging and analysis; visualization capabilities: and interoperabili- 
ty and data management protocols. 

As scalable parallel computing extends to a distributed computing environment, greater demands will 
be made upon the advanced network technologies developed and deployed through the NREN compo- 
nent. Operating systems and database management software for heterogeneous configurations of 
workstations and high performance servers will be developed along with remote procedure calls and 
interprocess communication protocols to support gigabit per second interconnections. 

Broad industry' involvement will be promoted through the identification and development of system 
structures using open interfaces. Industry involvement will also increase as computational approaches 
become available for more problem domains and more individuals arc trained in high performance 
computing, 

III. Computational Techniques 

Portable scalable software libraries are being developed to enable software to move across different 
computational platforms and from one generation to the next. The performance and generality of the 
new computing technologies will be evaluated using a variety of experimental applications. Standard 
systems-level tools will be developed to support visualization of data and processes. 

IV. High Performance Computing Research Centers (HPCRC) 

The HPCRCs will deploy prototype large scale parallel computing facilities accessible over the 
Internet through the integration of advanced and innovative computing architectures (both hardware 
and software). Computational scientists working on Grand Challenge applications, s(^ftware compo- 
nents and tools, and computational techniques will be able to access the largest advanced systems 
available in order to conduct a wide spectrum of experiments and scalability studies. Through the 
HPCRCs, the HPCC Program will evaluate prototype system and subsystem interfaces, protocols, 
advanced prototypes of hierarchical storage subsystems, and high performance visualization facilities. 
This work is done in cooperation with the Hvaluation of Early Systems clement of the HPCS compcv 
nent. 
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Major FY 1993 activities and accomplishments and FY 1994 plans 



Grand Challenges Research 

The majority of ASTA Grand Challenge research has focused on key computational models using first 
generation HPCC computers. This research will be extended to include applications software for mul- 
fidisciplinary applications, hybrid computational models, and heterogeneous and distributed problems 
on second generation computer testbeds. 



HPCC Agency Grand Challenge Research Teams 

NSF - Computational science and engineering in academic disciplines 

DOE - Energy and materials 

NASA - Aerosciences and Earth and space sciences 

NIH - Biomedical applications 

NOAA - Atmospheric and oceanic computational modeling 
- Environmental modeling 



Collaboration with industry and academia, primarily through CRADAs and consortia .s a h,gh pnon- 
ty Collaborative efforts are currently underway in the areas of environmental and Earth sciences, 
computational physics; computational biology, computational chemistry; material sciences; and com- 
putational fluid and plasma dynamics. 

A four day "Workshop and Conference on Grand Challenge Applications and Software Technology- 
was held during Mav 1993 in Pittsburgh. PA. Funded by nine HPCC agencies, it brought together 
some 10 Grand Challenge teams. Discussions centered on multidisciplinary computational science 
csTarch issues and approaches, the identification of major technology challenges facing users and 
pn^ders and refinements in software technology needed for Grand Challenges research apphca lons. 
A special session was devoted to industrial applications, including the aeronautics, automotive, chemi- 
cal, energy, financial, health care, and textile industries. 




Software Sharing 

The large collection of software needed to address the Grand Challenges and other computationally 
intensive problems is certain to grow at a rapid rate. Effective and efficient mechanisms to manage 
and reuse this software are essential. 

Toward this end. NASA coordinates the collection of and access to a high performance computino 
.software reposito^/. The High Performance Computing Software Exchange uses ARPA's wide area 
file .systems and NASA's distributed access to electronic data to connect .software repositories in .sev- 
eral Federal agencies. The.se repositories include netlib from NSF and DOE, and NISTs Guide to 
Availabk Mathematical Software (GAMS) (described on pages 148-149 in the Case Studies section) 
They will be expanded to include databases and bibliographic archives. 

Mosaic, a hypermedia interface to repositories throughout the Internet, including gopher and WAIS 
has been developed by the National Center for Supercomputer Applications (NCSA). In addition to 
providing a means to brouse the Internet, it enables research results to be electronically published 
with text, images, image sequences, software libraries, and other re.sources. (Mosaic screens are 
.shown on page 67 in the NSF section.) 

An HPCC Software Exchange Prototype System is being built to establish foundations and guidelines 
tor software submission standards, directories, indices, and Unix client/.server interfaces The critical 
processes and procedures to be used are derived from a 1992 Software Sharing Experiment which 
Identified and reviewed current software and .set priorities and mechanisms for creatine needed soft- 



ware. 



Supercomputing Centers and Consortia 

Two examples illustrate the collaborative efforts initiated through the HPCC Program: 

^The Concurrent Supe.Computing Consortium (CSCC) is an alliance of universities, research 
laboratories, government agencies, and industry that pool their resources to gain access to 
unique computational facilities and to exchange technical information, share expertise, and col- 
laborate on high performance computing, communications, and data storage issues, CSCC 
members are: 

ARPA 

Argonne National Laborator>' 
California Institute of Technology 

The Center for Research on Parallel Computation (an NSF Science and 

Technology Center) 
Intel's Supercomputer Systems Division 
Jet Propulsion Laborator>' 
Los Alamos National Laborator>' 
NASA 

Pacific Northwest Laboratory 

Purdue University 

Sandia National Laboratory 

-iThc National Consortium for High Performance Computing u as initiated h> ARPA to accelerate 
advances in high performance c(nnpuiing technology. It focuses on 1 ) software and applications 

ERLC 



development, and 2) the fostering of interdisciplinary collaboration among DOD and other 
Federal agencies and laboratories, industry, academic partners, and other research and develop- 
ment organizations to solve important problems in defense and national security, hiitiatcd in 
coordination and consultation with NSF using non-HPCC funds, this Consortium is an example 
of how HPCC technologies are being deployed on a national scale. 

Scalable parallel systems are also located at the NSF sponsored Supercomputer Centers ~ the Cornell 
Theory Center (CTC), the National Center for Supercomputer Applications (NCSA) at Champaign- 
Urbana, the Pittsburgh Supercomputer Center, and the San Diego Supercomputer Center (SDSC). 
Plans are underway to establish a "metacenter" in which these Centers will be interconnected via high 
performance networks, allowing their supercomputing resources to be used as if they were an integrat- 
ed high pcrfonnance computing system, 

NSFs Supercomputer Centers offer an interdisciplinary' and collaborative environment for industrial 
and academic researchers. More than 100 corporations have formal affiliations with the Centers 
resulting in transition of enabling technologies and expertise. The Centers also work directly with 
vendors to identify and predict the needs of the computational science research community and to 
develop and test hardware and software systems. Special programs at the Centers are funded by other 
agencies, including the NIH Biomedical Research Technology program in biomedical computing 
applications at CTC and NCSA. Other federally-supported high performance computing activities not 
coordinated or budgeted through the HPCC Program, such as the National Center for Atmospheric 
Research (NCAR) in Boulder, CO, maintain important connections with HPCC. 

DOE and NASA have also established HPCRCs. These include the DOE facilities at Los Alamos 
National Laboratory and Oak Ridge National Laboratory and NASA facilities at Ames Research 
Center and the Goddard Space Flight Center. 

The Consortium on Advanced Modeling of Regional Air Quality (CAMRAQ) is working to develop 
pollution modeling systems, such as the regional environmental impact of pollutants including ozone, 
sulfate, nitrates, and articulates. Participants include: 

Federal organizations 

Defense Nuclear Agency 

EPA 

NASA 

NOAA 

Aeronomy Laboratory 

Atmospheric Research Laboratory 

National Meteorological Center 
National Park Service 

L^S. Army Atmospheric Sciences Laboratory' 

Federally-chartered institutions 

National Academy of Sciences/National Research Council 

State and local organizations 

California Aii" Resources Board 

Northeast States for Coordinated Air l\e Management 

South Coast Air Quality Management District 
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Industrial organizations 

American Petroleum Institute 
Chevron Research Corporation 
Electric Power Research Institute 
PG&E 

Southern California Edison Company 

International organizations 

Environment Canada, Atmospheric Environment Service 

EUROTRAC/EUMAC 

Ontario Ministry of the Environment 

DOE AND NASA are responsible for coordinating Grand Challenges applications software develop- 
ment, and are coordinating testbed development to ensure that a diverse set of computing systems are 
evaluated. Applications software and high performance computing benchmarks will be used by par- 
ticipating agencies to evaluate high performance computing system options, A key component of this 
effort will be to provide feedback to developers of teraops systems. 



ASTA Milestones 



FY 1993 '1994 

-^Demonstrate initial multidisciplinary Grand Challenge applications. 
^Deploy lOO-gigaops systems to major high performance computing centers. 



FY 1994 

-J Complete initial software components and tools for large scale systems, 
-J Deploy HPCC prototype libraries to the Nil, 

Beginning in FY 1994 

Deploy 300-gigaops systems to major high performance computing centers and enable their use. 
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Information Infrastructure Technology 
and Applications (IITA) 



The IITA component of the HPCC Program is a research and development program intended to: 

Develop the technology base underlying a universally accessible National Information 
Infrastructure (Nil). 

J Work, with industry in using this technology to develop and demonstrate prototype "National 
Challenge" applications. 

National Challenges are major societal needs that high performance computing and communications 
technology can address in areas such as the civil infrastructure, digital libraries, education and lifelong 
learning, energy management, the environment, health care, manufacturing processes and products, 
national security, and public access to government information. The list of National Challenges is 
dynamic and will expand as the technologies and other applications mature. 

Solution of these National Challenges requires a three-part technology base consisting of the following 
services, tools, and interfaces: 

J Services that are common to and necessary for the efficient operation of the Nil. For example, 
conventions and standards are needed to handle different formats of data such as text, image, 
audio, and video. 

Tools for developing and supporting common services, user interfaces, and Nil applications. 
Intelligent user interfaces to Nil applications. 

The IITA component depends criticalK on the technologies already developed by the HPCC Program, 
and places its own set of demands on the Program, IITA efforts will strengthen the underlying HPCC 
technology base, broaden the market for these technologies, and accelerate industry development of 
the Nil. 

The Federal agencies that participate in the HPCC Program will work with industry und academia to 
develop these technologies. The Nil, however, will be built and operated primarily by the private sec- 
tor, which can form new markets for products and services enabled by the emerging Nil, This joint 
effort by government, industrx*, academia, and the public lo develop the Nil and address the National 
Challenges will require: 

J Deployment of substantially more high performance computing systems of increasingly higher 
performance. 

A nationwide ccMiimunications network with vastly greater capacity for connections and 
throughput than today's Internet. 



-"Further development and wider deployment of applications software for computationally inten- 
sive problems such as the Grand Challenges. 

Education of large numbers of developers of Nil technologies and training of a Nation of users. 



Users of the early Nil will be able to take advantage of small to moderate capacity computers and 
slow to medium speed communications, provided they have high quality user interfaces and access to 
the applications. As user interfaces improve, more computing and communications performance may 
be required. This can be achieved through the continual advances in the underlying technology devel- 
oped under the HPCC Program. 

The HPCC Program's original focus on research and development will continue to play a pivotal role 
in enhancing the Nation's computing and communications capabilities. For example, the Grand 
Challenges will continue to provide the scientific focus for critical computing technologies because of 
their profound and direct impact on fundamental knowledge. The IITA component will enable the 
extension of these technologies and the development of National Challenge applications that have 
immediate and direct impact on critical information systems affecting every individual in the Nation. 
Distinctions between National Challenges and Grand Challenges are shown in the table on the next 
page. 



The following two examples illustrate potential applications of the NIL 



A Medical Emergency 

Having taken ill, a traveler is hospitalized and undergoes tests, including X-rays, CAT scans, and 
MRI. At the same time, the attending medical professionals quickly retrieve test results from the trav- 
eler's last physical examination. The images are compared, diagnoses made, and treatments pre- 
scribed. This scenario is difficult if not impossible to implement today, in part because diagnostic 
images are commonly not in computer-readable form and network speeds are generally too slow to 
transmit large three-dimensional image data sets. 

Truly remote medical care will depend on services, standards, tools, and user interfaces to store, find, 
transmit, manipulate, display (and superimpose), compare, and analyze three-dimensional image data 
from several sources. Diagnostic test results and large image data sets from the physical examination 
must be available on computers that can be accessed from the hospitals computers over a communica- 
tions network: they must be retrieved quickly: the scientific data used in guiding the diagnosis and 
treatment must also be available from electronic libraries and must be quickly retrieved: and the priva- 
cy of these patient records must be protected. All of this supposes completion of rather extensive and 
complex inter-professional medical arrangements. In addition, it must be done using a user interface 
customized for the practice of "distance medicine," including collaborations among different sources 
of expertise. 
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Contrasts Between Grand Challenges and National Challenges 




Grand Challenges 


National Challenges 


Focus 


Computation intensive 


Information intensive 


Users 


Computer scientists and computa- 
tional scientists, extending to sci- 
entists and engineers (numbering 
in tfie millions) 


Information and application users 
in major na'.ionai sectors, extending 
to all sectors (numbering in tiie 
hundreds of millions) 


Distribution ofHPCS 
Resources 


Focus on largest systems at "cen- 
ters" and smaller systems for soft- 
ware development 


Focus on distributed systems of 
moderate scale with many users, 
scaling with increasing number of 
users 


Main HPCS Use 


Workstation client/server systems 
for computing and systems devel- 
opment, scaling witii scientific 
needs 


Workstation client/server systems 
for access to and processing of 
information with extensions to 
mobile and wireless systems 


Main NREN Use 


Share computing resources, data^ 
and software; collaboration 


Support distributed systems 


Main ASTA Use 


Scientific software for computation- 
ally-intensive applications 


Computationally-based services 


Privacy and Security 


Desirable but not critical to deploy- 
ment; essential in long term 


Essential for deployment 


Copyright 


Desirable but not critical to deploy- 
ment 


Essential for deployment 


Network 
Performance 


Higti among largest scale computer 
systems and users needing visual- 
ization 


Nominal to all involved, moderate 
to most when needed, high to 
those with greatest need 
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A Weather Emergency 

Using a real-time weather forecast for the area 20 miles directly ahead, a trucker diverts to an alternate 
route and reduces by hours the potential delay in delivering critically needed parts to a company that 
uses a just-in-time inventory system. Relayed from a weather forecast center to the truck's on board 
navigation system, this highly accurate forecast that pinpoints developing adverse weather conditions 
is made possible by the use of new computer weather prediction models that exploit the capabilities of 
high performance, massively parallel computing systems. 

Already, advances in computing and communications technologies have led to significant improve- 
ments in weather forecasting. As illustrated in the recent case of Hurricane Andrew in Florida, this 
improved forecasting can save li\es as well as millions of dollars in evacuation costs through better 
targeting of evacuation efforts. 

Services, standards, tools, and user interfaces are required to build and support systems for acquiring 
large amounts of three-dimensional environmental data from different sou^'ces (e.g„ in situ and remote 
sensing observations). These systems must also support high resolution modeling using these data, 
incorporating improved representations of the physical environment, and a real-time information dis- 
semination capability lo provide detailed forecast information for hundreds of different locations to 
thousands of users. 

Unlike the first example, the user community tor environmental information is larger and more 
diverse. Weather forecasts are needed by the general public, and for aviation, ship navigation, and 
agriculture, for example, while HPCC-funded researchers use much of the same observational data to 
model global change. Starting with user interfaces tailored to different kinds of users, individual users 
customize them for their own needs, Tne delivery and use of environmental information for this broad 
range of applications is performed by a partnership of government and \ alue added private sector 
information companies, all part of the NIL r 

The IITA component will enable the development of an integrated infrastructure so thai these two 
apparently unrelated applications can work together efficiently. This infrastructure includes: 

A networked computing base that provides appropriate performance. 

-"Methods to provide security, privacy, and copyright protection, and other services such as "digi- 
tal signatures" to authenticate transactions. 

-•Technical conventions and standards (especially for databases). 

Tools to build and support the user interfaces. 

-< Tools to build and support the applications themselves. I 



The IITA component will demonstrate these iechnologics through testbed and pilot projects. These 
projects will evaluate new technologies, provide training in their use, and demonstrate specific 
National Challenge applications. Successful projects will serve as models to be further refined and 
engineered for larger scale deployment. 
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In order to facilitate the deployment of the Nil by the private sector, the government will work closely 
with industry, academia, and users on all aspects of the IITA component. The private sector is expect- 
ed to deploy many of its own applications, in areas such as commerce and entertainment. The govern- 
ment's goal is that from the user's point of view these applications will be integrated as seamlessly as 
possible into a single NIL with appropriate use restrictions and protections incorporated as needed. 



The IITA component is organized into four interrelated elements. Each builds on the foundation of 
the HPCC Program and, in large measure, builds on its predecessor. 



L Information Infrastructure Services 

These are the basic services and interfaces, and the underlying technical conventions and standards, 
that provide the common foundation for a broad range of information technology-based applications. 
Building upon the Interagency Internet, these modular units will in turn be the building blocks of the 
Nil applications. These include: 

^Data formats and object structures (including single- and multimedia formats such as image, 
audio, and video). 

^Methods for managing distributed databases. 

-J Services that provide access to electronic libraries and computer-based databases. 

-j Methods for exchanging data (e.g., data compression) and integrating data (e.g.. merging and 
overla>ing images) from one or more electronic libraries and computer-based databases. 

^ Services to search for and retrieve data and objects. 

^Protocols and processes such as "digital signatures" needed to obtain appropriately secure and 
legal access to information (including protection of copyrighted material). 

^ Usage metering mechanisms to enable implementation of payment policies. 

-j High integrity, fault-tolerant, trusted, scals^ble computing systems. 

J Protocols and processes needed to obtain the appropriate communications speed and bandwioth. 
II. Systems Development and Support Environment 

This element includes a comprehensive suite of software tools and applications methods such as soft- 
ware toolkits and software generators for use by computer programmers, tools and methods for inte- 
grating elements of virtual reality systems, collaboration software systems, and applications-specific 
templates and frameworks. They will be used to: 

Interface to existing services (for example, existing search services). 

J Develop new distributed services for the Information Infrastructure Services elemeni and for the 
Nil. 
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-•Develop generic user interfaces, including templates and frameworks, to facilitate the use of the 
services provided by the Information Infrastructure Services element in the development of 
advanced and customized user interfaces by the Intelligent Interfaces clement described below. 



-•Develop generic applications, including architectures and frameworks, for use in the Intelligent 
Interfaces element and for use by applications developers in implementing applicationb such as 
the National Challenges and other applications in the Nil. 

This element also includes the systems simulators and modeling methods to be used in designing the 
technology underlying the NIL 

IIL Intelligent Interfaces 

In the future, high level user interfaces will bridge the gap between users and the NIL A large collec- 
tion of advanced human/machine interfaces must be developed in order to satisfy the vast range of 
preferences, abilities, and disabilities that affect how users interact with the NIL 

Intelligent interfaces will include elements of computer vision and image understanding; understand- 
ing of language, speech, handwriting, and printed text; knowledge-based processing; and multimedia 
computing and visualization. In order to enhance their functionality and ease of use. interfaces will 
access m.odels of boJi the underlying infrastructure and the users. Just as people now do their own 
"desktop publishing," they will have their own "desktop work environments." environments that will 
extend to mobile and wireless networking modes. Users will be able to customize these environments, 
thereby reducing reliance on intermediate interface developers. 

IV. National Challenges 

National Challenges are fundamental applications that have broad and direct impact on the Nation's 
competitiveness and well-being. They will enable people to handle the increasing amounts of infor- 
mation and the increasing dynamics of the 21st century. 

Using selected HPCC enabling technologies and the technologies developed by the other IITA ele- 
ments, th's element will use pilot projects to develop "customized applications" in areas such as the 
civil infrastructure, digital libraries, education and lifelong leaniing. energy management, the environ- 
ment, health care, manufacturing processes and products, national security, and public access to gov- 
ernment information. Detailed goals of four of these applications areas are as follows: 

Digital Libraries 

Develop systems and technology to: 

-J Enable electronic publishing and multimedia authon'ng. 



J Provide technology for storing petabytes of data for nearly instantaneous access by users nuni- 
berinii in the millions or more. 



I 

m 



-•Quickly search, filter, and summari/e large volumes of information. 
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^Quickly and accurately convert printed text and "pictures" of all forms into electronic form. 
^Categorize and organize electronic information in a variety of formats. 
^ Use visualization to quickly browse large volumes of imagery. 
^ Provide electronic data standards. 

-J Simplify the use of networked databases in the U.S. and worldwide. 

Protolypic scientific data bases, including remote-sensing images, will be developed. Librarians and 
other users will be trained in the development and use of this technology. 

Education and Lifelong Learning 

Conduct pile projects that connect elementary and secondary schools to networks through which stu- 
dents and teai irs can: 

Communicate with their peers and with students and faculty at colleges and universities across 
the country. 

Access information databases and other computing resources. 

-I Use authoring tools to embody the experiences of the best teachers in systems that others can 
use. 

-I Have greater access to the Nil technologies, enabling them to develop and use them more effec- 
tively. 

-J Enable future generations to be literate in information technology so that they will be prepared 
for the 21st century and beyond. 

Health Care 
Develop and provide: 

-J Access to networks that link medical facilities and enable health care providers and researchers 
to share medical information. 

-J Technology to visualize and analyze human anatomy and to simulate medical procedures such 
as operations. 

-J The ability to treat patients in remote locations in real-lime by haN'ing "distance collaborations" 
with experts at other medical facilities. 

-JTcclmology by which health care providers can readily access databases of medical infonnation 
and literature. 
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-J Technology to store, access, and transmit patients' medical records and protect the accuracy and 
privacy of those records when doing so. 



Manufacturini^ 

Research and development to: 

-J Prototype advanced computer-integrated manufacturing systems and computer networks linking 
these systems. 

-J Work \\'ith industry' in implementing standards for these advanced manufacturing operations, 
and process and inventor>' control. 

-J Transition the manufacturing process to the new scalable computing and networking technology 
base. 



-J Train management and employees in advanced manufacturing. 



54 



Basic Research and Human Resources 
(BRHR) 

The BRHR componcnl is designed lo increase the (low of innovative ideas by encouraging invcsliga- 
lor-inilialed, long-term research in scalable high performance compuiing: lo increase the pool of 
skilled and trained personnel by enhancing education and training in high performance computing and 
communications: and to provide the infrastructure needed to support these research and education 
activities. 

The BRHR component is organized into four elements: 
L Basic Research 

This element supports increased participation b\ individual investigators in conducting disciplinary 
and multidisciplinary research in computer science, computer engineering, and computational science 
and engineering related to high performance computing and communications. Research topics 
include: 

-1 Foundations of future high performance coiiiputing systems. 

•J High performance hardware components and systems, high density packaging technologies, and 
system design tools, 

J Mathematical models, numeric and symbolic algorithms, and libraiy development for scalable 
and massively parallel computers. 

-^High level languages, performance prediction models and tools, and fault tolerant strategies for 
parallel and distributed systems. 

j Large scale database processing: knowledge based processing: image processing: digital 
libraries: visualization: and multimedia computing. 

•^Resource management strategies and software collaboratory environments for scalable parallel 
and heterogeneous distributed systems. 

11. Research Participation and Tralf^ing 

This element addresses the human resources pipeline in the computer and computational sciences, at 
• ndergraduate, graduate, and postdoctoral (training and re-training) levels. Activities include: 

•^Workshops, short course^, and seminars. 

J Fellow ships in computational science and engineering and experimental computer science. 
-1 Career training in medical informatics through grants to yoiMig investigators. 
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-J Institutional training and postdoctoral programs; knowledge transfer exchange programs at 
national laboratories, centers, universities, and industr)', 

-J Software dissemination through national databases and libraries. 
IIL infrastructure 

This element seeks to improve university and government facilities for computer science, computer 
engineering, and computational science and engineering research related to high performance com.put- 
ing. Activities include: 

-J Improvement of equipment in computer science, computer engineering and computational sci- 
ence and engineering academic departments, centers, and institutions: development of scientific 
databases and repositories. 

-J Distribution of integrated system building kits and software tools. 
IV. Education, Training, and Curriculum 

This element seeks to expand existing activities and initiate new efforts to improve K-12, undergradu- 
ate, and graduate level education and training opportunities in high performance computing and com- 
munications technologies, computational science and engineering for both students and educators. 
The introduction of associated curriculum and training materials at all levels is an integral part of this 
effort. Activities include: 

•J Bringing people, especially teachers, to national centers and laboratories, for summer institutes 
and other training, technology transfer, and educational experiences. 

-J Utilizing professional sciennsts and engineeis to provide curriculum deveiopment materials and 
instruction for high school students in the context of high school supercomputer programs, 
supercomputer user workshops, summer institutes, and career development informatics for 
health sciences. 



BRHR Component Implementation 

Each agency that participates in the BRHR component sponsors research participation and 
education/training programs designed to meet specific mission needs. vSom.c of these activities are as 
follows. 

-JARPA supports basic research in such areas as high performance components, high density 
packaging, scalable concepts, system design tools and foundations ol petaops systems. 

-JNSFs basic research programs promote innovative research on the foundation sciences and tech- 
nologies of HPCC as well as specific disciplinary activities in HPCC. NSr' coordinates its basic 
research and infrastructure activities to foster balance in the multiagency HPCC' Program. 
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Through its "research experiences for undergraduates," SuperQuest, postdoctoral, graduate fel- 
lowship, educational and minority infrastructure programs, NSF addresses long term national 
needs in HPCC. 

•J DOE supports basic research to advance the knowledge of mathematical, computational, and 
computer sciences needed to model complex physical, chemical, and biological phenomena 
involved in energy production and storage systems. DOE also is actively involved in education 
and training activities at all levels. 

-•NASA conducts basic research through NASA research institutes and university block grants, 
including support at the graduate and postdoctoral level. 

^NIH supports basic research and training in the use of advanced computing and network com- 
munications. Predoctoral and postdoctoral grants for career training in medical informatics are 
being expanded. 

-•NOAA conducts basic research in computational fluid dynamics applications in atmospheric and 
oceanic processes. 

-J EPA sponsors targeted fellowships and basic research activities, and develops and evaluates 
training methods and materials to support transfer of advanced environmental assessment tools 
to Federal, state, and industrial sectors. 

Partnerships with industry, universities, and government help accomplish BRHR objectives. 



FY 1993 Accomplishments 

In FY 1993, more than 1,000 research awards fund the following activities: 

-J Basic research in high perfomiance computational approaches to materials processing, molecu- 
lar structures, fluid dynamics, and structural mechanics. 

Basic research on scalable parallel systems in fundamental area.^ of mathematical models, algo- 
rithms, performance evaluation techniques, databases, visualization and multimedia computing, 
digital libraries, and collaboratory technologies. 

-J An increased number of computer and computational science and engineering postdoctoral 
awards and graduate fellowships. 

-J High school honors programs, teacher training programs and "research experience for under- 
graduates" in HPCC. 

J The introduction of the computational science textbook, which involved 24 authors in 10 differ- 
ent disciplines, into classrooms as part of a pilot project for Computer Science for High School 
Teachers. 
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J Institutional infrastructure awards to support experimental and novel high perfonnance comput- 
ing research at universities and national laboratories. 

-1 Educational and minority infrastructure awards in undergraduate institutions. 



FY 1994 Plans 

J Develop a program to apply the principles of artificial intelligence to advanced intelligent manu- 
facturing. 

^ Develop a program to integrate virtual reality technology into high performance computing and 
communications systems. 

J Develop an initiative in digital libraries. 

Increase research in real time, three-dimensional imaging and multimedia computing. 

^ Increase support of information intensive applications of HPCC technologies in health care, 
information libraries development, education, and manufacturing. 

-J Increase support for scalable parallel computers. 

-J Increase education and training activities in HPCC through establishment of network-based edu- 
cational testbeds. 



-J Increase number of postdoctoral and graduate fellowship awards. 
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Advanced Research Projects Agency 
(ARPA) 

As the HPCC Program reaches the middle of its initial five-year phase, the ARPA program 
is shifting focus from stimulating the development of the new scalable computing technology 
base and early experimental use toward developing the technologies needed to enable a 
broad base of applications and users, including their extension to a National Information 
Infrastructure. In addition, the foundations for future generations of computing systems 
involving even more advanced technologies are being developed. 

The current scalable computing technology base is char- 
acterized by the first 100 gigaop class computing sys- 
tems that are being experimentally used on a wide vari- 
3ty of problems in the scientific and engineering 
research communities. Scalable operating systems are 
enabling software development on high performance 
workstations connected to higher performance servers 
through networks. 

: The experience gained in the early experimental I'se of 
these new computing technologies is used to refine the 
next generation and guide the development of more 
advanced software and system development technolo- 
gies. The combination of scalable computing and scal- 
able networking technologies provides the foundation for 
solving both Grand Challenges with large scale parallel 
systems and National Challenges with large scale dis- 
tributed systems. This enables HPCC to progress 

■ toward an Nil. 

ARPA is the lead DOD agency for advanced technology 
research and has the leadership responsibility for High 
Performance Computing (HPC) within DOD. The ARPA 
HPC Program develops dual use technologies with 
broad applicability to enable the defense and intelligence 
communities to build on commercial technologies with 
rapid development of more specific characteristics when 
needed. ARPA has no laboratories or centers of its own 
and executes its programs in close cooperation with the 
Office of Naval Research, the Air Force Office of 
Scientific Research, the Army Research Office, Service 
Laboratories, the National Security Agency, and other 
DOD organizations and Federal agencies. ARPA partic- 
ipates in joint projects with other agencies in the Federal 
HPCC Program, a variety of Defense agencies, the 
Intelligence community, and other Federal institutions. 
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Joint projects with other agencies are established to 
accelerate technology development and transition. 
ARPA joint projects with NSF include foundations for 
scalable systenns, visualization, Grand Challenges, giga- 
bit networks, and accelerating the nnaturation of systems 
software at NSF Supercomputer Centers. Joint projects 
with NASA include an Internet software exchange, sys- 
tem software maturation, and ground stations for the 
ACTS gigabit satellite system. ARPA, NSF, and NASA 
also have a joint program in digital libraries. Joint pro- 
jects v/ith DOE include scalable software libraries and 
networking applications. ARPA is working with NIST to 
develop performance measurement technologies and 
techniques, privacy and trusted systems technologies, 
and the computer emergency response team system for 
the Internet. A joint project with NSA is developing giga- 
bit network security technology and other secure and 
trusted systems technologies. In addition, a variety of 
early evaluation and experimental use projects involve 
different kinds of scalable parallel computing systems. 



The ARPA program focuses on the advanced technolo- 
gy aspects of all five components of the HPCC Program 
as follows: 




A multi-year Caltech project developed 
high performance interconnect and fine- 
grained parallel systems including 
boards consisting of 64 single nodes, 
scalable to thousands of nodes. 
Several commercial systems have 
adopted architectures based on this 
research, and are beginning to demon- 
strate how low cost modules can be 
configured to meet a broad range of 
applications. 



HPCS 

ARPA projects stimulate the development of scalable 
computing technologies that are capable of being con- 
figured as networks of work?tationf. and large scale par- 
allel computing systems capable of sustaining trillions of 
operations per second. Systems can be configured over 
a wide perform^^nce range. The systems will be bal- 
anced to provide the processor-to-memory, scalable 
interconnection, and input/output bandwidth needed to 
sustain high internal and external system performance. 
The modular design of the system units of replication 
will enable them to cover the full range from worksta- 
tions to the largest scale distributed and parallel sys- 
tems. Scalable systems with vector accelerators may be 
configured as parallel vector systems. Other kinds of 
accelerators such as field programmable logic arrays 
may be added for specialized applications. The largest 
scale parallel systems with hundreds to thousands of 
processors or more, are sometimes referred to as mas- 
sively parallel systems. The input/output interfaces of 
these systems may be used to configure heterogeneous 
systems with high performance networks. 
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Scalable microkernel operating systems with a full com- 
plement of servers will enable software and system 
developers to work with a uniform set of application 
interfaces over the scalable computing base. Through 
the use of multiple servers, different application inter- 
faces can be supported to enable the transition from 
legacy systems such as those available today. The sys- 
tem software may be configured as needed for particular 
applications including trusted and real-time systems. 

Advanced components and packaging technologies 
including the associated design, prototyping, and sup- 
port tools will enable higher performance and more com- 
pact systems to be developed. These technologies also 
enable the development of embedded systems so that 
computing can be put in specialized physical and envi- 
ronmental settings (such as airplanes, spacecraft, land 
vehicles, or ships). 

Early evaluation and experimental use of new computing 
systems is an integral part of the overall development 
process. Policies and mechanisms have been devel- 
oped that enable the timely purchase of new small to 
medium scale computing systems for the purpose of 
early evaluation and experimental use. As these tech- 
nologies mature, larger scale systems are purchased 
and deployed by other parts of the HPCC Program in 
consultation with their user communities. 



NREN 



High Performance Networking 

3 



Experimental gigabit networks are over- 
faying and enhancing the Internet. 
ARPA's Networking Systems program 
develops and evaluates these technolo- 
gies as foundations for a global scale, 
ubiquitous information infrastructure 
supporting Grand Challenge, National 
Challenge, and Defense needs. 
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j ARPA projects develop scalable networking technolo- 

! gies to support the full range of applications from local 

i networks, to regional networks, to national and global 

i scale networks including their wireless and mobile 

; extensions. Different kinds of communication channels, 

i or "bitways", will be integrated to enable network con- 

I nectivity to be achieved between users and their applica- 

i tions. 

i Internet technologies will be developed to enable contin- 

' ued scaling of the networks to every individual and sys- 

j tem needing access. Scalable high performance net- 

, working technologies will be developed to enable gigabit 

i speeds to be delivered to the end users. A variety of 

\ networking testbeds developed in cooperation with other 

' agencies are used to develop, demonstrate, and experi- 

' mentally deploy new networking technologies. As these 

technologies mature, larger scale systems are deployed 

' by other parts of the Program in consultation with their 

user communities. 
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Modern Operating Systems 




Message passing, transparent access 
to user services, advanced memory 
management, and real time response 
are key to a new generation of portable 
microkernel-based operating systems. 
Coupled with scalable computing sys- 
tems, these operating systems enable 
the introduction of multilevel caches, 
scalable device interfaces, and scalabili- 
ty to thousands of processors. 



ASIA 

ARPA projects develop the advanced algorithms and 
software technologies needed for computationally inten- 
sive applications. Scalable software libraries will enable 
optimal performance for common problem domains. 
Extensions to existing programming languages and the 
development of new ones will make it easier to program 
scalable systems. Optimizing compilers for individual 
processors and their scalable configurations including 
support for memory and process allocation will enable 
maximal performance for a given algorithm to be 
achieved. Design, analysis, visualization, and debug- 
ging tools will enable the development and support of 
scalable parallel and distributed computing systems 
through the use of common integrated frameworks. 
This will provide the foundation for the software and sys- 
tem development and support environments needed for 
computationally intensive problems such as the Grand 
Challenges. The application of HPCC technologies to 
specific Defense problems is performed by other ARPA 
or Defense programs. 



IITA 



ARPA projects will develop the information infrastructure 
technologies needed for information and functionally 
challenging applications that emphasize information pro- 
cessing. Advanced Internet-based services will be 
developed to enable the effective deployment of dis- 
tributed Internet- based systems including multiple media 
with access to high performance computing services 
and individual access points. Mobile and wireless tech- 
nologies will enable users and their networks to access 
the information infrastructure with the appropriate 
authentication, privacy, and security. 



Distributed data and object bases with transparent repli- 
cation will enable the development and deployment of 
data, information, and knowledge repositories and ser- 
vices. A variety of access tools and interfaces will be 
developed to enable interactive access to the infrastruc- 
ture. These will include intelligent functions such as 
knowledge based searching and alerting, planning and 
learning systems, and natural language understanding 
systems for speech, text, and images. This will provide 
the foundation for solving the large scale distributed, 
information and functionally intensive problems such as 
the National Challenges. 
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The BRHR component is generally structured as an inte- 
gral part of the other components. The ARPA program, 
along with NSF, provides the majority of Federal support 
to universities in computer and computational science. 
Fundamental limitations of HPCC technologies are iden- 
tified and alternatives developed that will provide the 
basis for more advanced technologies in the future. An 
Historically Black Colleges and Universities program 
identifies individuals and groups that have the potential 
to contribute to the program. Small Business Innovation 
Research topics are formulated to provide another 
opportunity for small businesses to participate in the pro- 
gram. University projects provide an extraordinary 
opportunity to attract new people into the program, ben- 
efit from their talent, and prepare them for the new tech- 
nologies. Basic research programs are often estab- 
lished in cooperation with NSF. 



The three interconnected layers of the 
Nil are a variety of "Bitways" for com- 
munication, services for i ) format ion- 
based and computation-based 
resources, and National Challenge 
applications. Each layer focuses on 
protocols for common delivery mecha- 
nisms in order to insulate users from the 
details of the underlying technologies. 
In so doing, each layer sustains a 
diverse base of technologies and sup- 
ports a broad base of suppliers. 
Communications protocols, for example, 
ensure delivery in a uniform manner; 
protocols for multimedia multicast and 
other sen/ices provide similar uniformity 
to applications developers: and applica- 
tions developers use scalable open pro- 
tocols to make rapid advances without 
major sen/ices reengineering. 



Major FY 1994 Milestones 

! Develop system architectures for affordable computing 
1 systems, scalable from workstations to teraops systems. 

: Demonstrate scalable libraries, components, and tools 
' to support software development on a scalable parallel 
system. 

Develop and deploy gigabit networking protocols based 
on experimental testbed results. 

■ Develop information infrastructure system architectures 

■ and eariy prototype services. 
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National Science Foundation (NSF) 



NSF's HPCC program ^jrovides support for basic research in HPCC technologies and appli- 
cations, national HPCC facilities and services, computational infrastructure, and education 
and training. The program attempts to strategically guide broad currents of scientific inquiry 
and discovery into critical application problem domains. In FY 1994, NSF will continue to 
highlight interdisciplinary research, increased collaboration between computer scientists 
and application scientists, and cross-sector partnerships. Areas that address pressing inter- 
ests of science and the broader society will be targeted. 



Major NSF activities are planned in all five components 
of the HPCC Program. Program activities are imple- 
mented and executed through the existing NSF disci- 
plinary program structure. An HPCC Coordinating 
Group with a representative from each NSF research 
directorate is responsible for assuring program develop- 
ment and management consistent with the goals and 
objectives of the HPCC Program. The result is a 
shared-management, NSF-wide process touching on 
almost all science and engineering disciplines. In FY 
1992 over 1,200 individual awards were made by 75 
separate disciplinary program offices. All HPCC awards 
are subject to the Foundation's merit-based peer review 
process. 

NSF will continue to pursue substantial industry parj'ci- 
pation and collaboration. Cooperation with industry is 
achieved programmatically both through the natural 
alignment of academic basic research interests in key 
HPCC areas and through the deliberate structuring of 
selected NSF programs to foster collaboration. These 
interactions stimulate the growth of shared knowledge 
and capabilities, improve the rate of technology transfer, 
and identify new technologies and products of commer- 
cial value. 




Two national NSF programs. NSFNET and the NSF 
Supercomputer Centers, could not be conducted at their 
present scope without significant industry interest and 
collaboration. Extensive industry involvement with the 
National Supercomputer Centers includes partnerships 
and affiliate relationships, cooperative efforts in technol- 
ogy development, and use of the centers' computing 
resources and training facilities. Affiliation with a center 
offers an innovative low risk method of exploring and 
ultimately exploiting the usefulness of high performance 
computing technologies in a diverse intellectual and 
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interdisciplinary environment. Currently about 130 non- 
academic affiliates or partners represent many areas 
including aerospace, automotive, financial, chemical 
products, and telecommunications. The centers are 
also engaged in software and s^'stems development 
with most of the major U.S. hign performance computing 
hardware vendors. 

Coordination of NSF activities with other agencies is an 
integral feature of the program. This entails multiagency 
planning activities leading to joint sponsorship of large 
scale research and infrastructure projects, scientific con- 
ferences and workshops, and development of shared 
resources. 



The approximately 130 industriai affiih 
ates and partners at the NSF 
Supercomputer Centers fall into the 
broad groups shown above. 



NSF Activities by HPCC Program Component 



HPCS 

The HPCS component focuses on the design and devel- 
opment of heterogeneous and distributed scalable paral- 
lel computing systems to advance computational sci- 
ence and engineering research capabilities. Included is 
research on: systems architecture, including applica- 
tion-specific systems and memory hierarchy; early pro- 
totyping and evaluation of hardware and software sys- 
tems; new tools for systems-level automated design and 
prototyping; distributed design and intelligent manufac- 
turing capabilities; and optical communications systems 
and devices. 



NREN 

NSF is responsible for overall coordination of the NREN 
component and the broad deployment of network infras- 
tructure and services. NREN component activities sup- 
port all aspects of the HPCC Program through connec- 
tion of other agency networks, upgrading of the 
NSFNET backbone network services, providing for 
enhanced network security, increasing the number of 
educational institutions connected to the network, and 
serving as a primary source of information about access 
to and use of the network. Activities focus on network 
infrastructure and services and on gigabit research and 
development. These activities are designed to develop 
and implement a wide range of networking infrastructure 
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components and services for the Nation's community of 
researchers, scholars, and students that will foster inter- 
action and collaboration; and to give rapid access to 
researchers and students to facilities and other 
resources for use in scholarly endeavors. These facili- 
ties and resources include computation centers, labora- 
tories, scientific instruments, and databases and 
libraries. NSF also participates in the support (under 
ARPA coordination) of the networking and communica- 
tions research and development effort leading to early 
deployment of advanced HPCC systems. This coordi- 
nated research effort includes work on very high speed 
switches and several wide-area research gigabit testbed 
networks in support of Grand Challenge collaborations 
and other applications. 



ASIA 



NSF centers directly 
supported within the 
ASTA component 
include: 

' Cornell Theory Center, 
Ithaca, NY 

- National Center for 
Supercomputing 
Applications, Champaign- 
Urbana, IL (NCSA) 

" San Diego Supercomputer 
Center, San Diego, CA 

- Pittsburgh Supercomputing 
Center, Pittsburgh, PA 

- Center in Computer 
Graphics and Scientific 
Visualization, University of 
Utah 

- Center for Research on 
Parallel Computation, Rice 
University, Hous.^on, TX 



The ASTA component emphasizes the development of 
algorithms and software technologies and the establish- 
ment of research capability to address Grand Challenge 
scale computational problems. Included in ASTA are: 
research demonstrating the applicability of HPCS prod- 
ucts to critical problems; building interdisciplinary collab- 
oration and exchange; collaborative Grand Challenge 
and large scale computational research; computational 
techniques and software technologies for scalable paral- 
lel and distributed heterogeneous computing systems; 
scientific databases; and deploying and configuring new 
parallel systems in research centers and testbed facili- 
ties accessible to researchers, students, and educators 
nationwide. 

NSF's National Supercomputer Centers and Science 
and Technology Centers are hubs of intellectual and 
educational activity, serving researchers, students, and 
teachers from many disciplines and educational levels. 
They seek to define and provide a premier environment 
for coordinated approaches to Grand Challenge prob- 
lems. The centers are currently implementing the con- 
cept of a "metacenter:" planning and working closely 
together, the individual centers pool their technological 
resources, support services and administrative functions 
so that the collective resources are viewed and made 
available to users as a single, powerful computing envi- 
ronment. With the metacenter concept, new systems 
and services can be incorporated into the overall envi- 
ronment without disturbing the stable computing environ- 
ment that is In place. The concept can also offer adoi- 
tional flexibility in managing and optimizing the centers' 
operations. 
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So 




Four sample NCSA Mosaic (described on 
page 44 in the ASTA section) screens show- 
ing access to images contained in public 
Internet digital data libraries. From top to 
bottom: 



• The Mosaic Demo document directly accesses 
a gopher server at the University of Illinois' 
Weather Machine containing current weather 
data (here the Flood of '93} 

• The Dinosaur fossil exhibit developed by 
Honolulu Community College The exhibit uses 
audio clips, images, and text to educate and 
entertain Users can take a narrated tour by 
selecting the audio links throughout the docu- 
ments 

• Two images from "Rome Reborn The Vatican 
Library and Renaissance Culture. ' an exhibit 
at the Library of Congress 

• Ono screen from this hypertoxt exhibit 

Botaivcai pages from Matcna Mcdtcj j I4th 
oi I5th century Itoluin mtinuSLnpt 



IITA component activities are designed to expedite the 
application of research products and services developed 
in the original four component areas to National 
i Challenges. Efforts in IITA will build on and integrate 
fundamental HPCC technologies in order to enable 
widespread progress on information-intensive applica- 
tions in such areas as the civil infrastructure, digital 
libraries, education and lifelong learning, the environ- 
1 ment, health care, and manufacturing. NSF will focus 
] primarily on building and promulgating intelligent user 
t interfaces, distributed software systems ani support 
i environments, standardized data management and 
i communications processes, and enhanced information 
! infrastructure services. IITA activities include: 

! 

I Support for development of tools and mechanisms 

I for enhancing human communication and collabo- 

I ration across the network. 

j -"Development of multimedia software and educa- 
I tional materials. 

i 

! -"Support for basic and strategic research on devel- 
! opment of advanced data capture, storage, repre- 

sentation, and retrieval technologies for "digital 
; libraries." 

I -"Training support for users in the generation and 
use of digital library resources, fostering "lifelong 
1 learning" opportunities and development of new 

i network-based training modalities. 

-"Pilot projects for information-intensive applica- 
tions. 



BRHR 

BRHR component activities are designed to encourage 
research projects and infrastructure and educational 
activities that ensure the flow of innovative ideas and tal- 
ented people into high performance computing technolo- 
gies and application areas. Activities include support for 
research in fundamental areas of algorithms, data struc- 
tures, programming languages, operating systems, soft- 
ware engineering, performance evaluation, databases, 
digital libraries, information science, knowledge process- 
ing, language and speech understanding, computer 
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On-Going Grand 
Challenge Applications 
Groups 

Biomolecular Design 

Coupled Field Problems and 
GAFD (Geophysical and 
Astrophysical Fluid 
Dynamics) Turbulence 

High Capacity Atomic-Level 
Simulations for Design of 
Materials 

Imaging in Biological 
Research 

Large Scale Environmental 
Modeling 

Machine Learning 

Radio Synthesis Imaging 



' vision and image understanding, and multimedia com- 
puting. BRHR also supports postdoctoral awards in high 
; performance computational science and engineering 
I and experimental computer science; undergraduate 
I research experience^., *niqh schooi teacher and student 
t training experiences at high performance computing 
centers; and infrastructure acquisition for computational 
■ research and education. 



Major FY 1993 Accomplishments 

-J Six to eight new Grand Challenge Applications 
Groups funded (listed in Side Bar). 

This program activity was initiated in FY 1992, with 
awards made to multidisciplinary groups of scien- 
tists and engineers whose activities integrated dis- 
ciplinary research with the design of models, algo- 
rithms, and software for high performance comput- 
ing systems. See Side Bar for areas in which 
awards were made. 

-J Research projects on techniques and environ- 
ments for scalable parallel and distributed hetero- 
geneous computing, collaboration technologies, 
evaluation of High Performance Fortran, program- 
ming language standards, and user environment 
components. 

-JMetacenter implementation in selected areas at 
the NSF high performance computing centers to 
provide new opportunities for the combined use 
and shared management of these systems and 
requisite supporting technologies. 

-J Deployment and configuration of scalable parallel 
systems for mainstream scientific computing at the 
NSF centers. 

-jNREN awards for Network Information Services; 
recompetition of the NSFNET Backbone; promul- 
gation of computer security measures; evaluation 
of the Network Access Point (NAP) concept; 
regional networks; and testbeds for teaching and 
education. 
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Grand Challenge 
Application Groups 
Initiated in FY 1993 

Adaptive Coordination 
Predictive Models with 
Experimental Observations 

Advanced Computational 
Approaches to Biomoiecular 
Modeling and Structure 
Determination 

Black Hole Binaries: 
Coalescence and 
Gravitational Radiation 

Earthquake Ground Motion 
Modeling in Large Basins 

High Performance Computing 
for Land Cover Dynamics 

Massively Parallel Simulation 
of Large Scale, High 
Resolution Ecosystem 
Models 

Parallel f/0 Methodologies for 
l/O'lntensive Grand 
Challenge Applications 

The Formation of Galaxies and 
Large-Scale Structure 

Understanding Human Joint 
Mechanics Through 
Advanced Computational 
Models 



FY 1994 Plans 

NSF will continue to support HPCC basic research activ- 
ities, metacenter implementation, Grand Challenge 
Application Groups, postdoctoral research associate- 
ships, and broader access to high performance comput- 
ing research resources for researchers, students, and 
educators at all levels. Support for NREN development 
will continue to meet special NSF obligations and 
responsibilities set forth in the HPCC Program pian, 
including the development of gigabit testbeds. New 
activities will support the migration of technologies and 
capabilities developed in the original HPCC Program 
component areas to address specific applications asso- 
ciated with such areas as health care, lifelong learning, 
digital and electronic libraries, and manufacturing. 



HPCS support will focus on: 

-J Developing new systems level design tools that 
have Increased functionality, are highly automat- 
ed, and accept high level specifications and algo- 
rithms as input. 

-J Novel computing system design approaches 
drawing on expertise in architecture, systems soft- 
ware, storage technology, 1/0 subsystems, and 
networking technologies. 

-J Optical communications devices and systems. 

-J Advanced computer and Information technologies 
to enable distributed design and intelligent manu- 
facturing of objects. 

-J Systems-level issues In understanding, modeling, 
and integrating component manufacturino tech- 
nologies. 

NREN activities will include: 

-J Development of a very high speed backbone. 

-J Increasing the number of network access points 
(NAPs). 

-J Funding, improving, and providing new services 
for mid-level . <3tworks. 
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-i Funding a routing authority. 

J increasing connections for post-secondary educa- 
tion and related organizations. 

ASIA activities will inciude: 

-» Additional Grand Challenge Application Groups 
awards. 

•J Research on computational techniques for dis- 
tributed and heterogeneous computing environ- 
ments. 

-•Continued metacenter development and the adop- 
tion of common standards for hardware, software, 
and networking technologies. 

-I Deployment of prototype scalable systems in 
Grand Challenge research settings. 

-I Collaborative activities on software systems, archi- 
tectural modifications, new programming language 
standards, and user environment components. 

-•Projects demonstrating the usability of High 
Performance Fortran and other high level lan- 
guages for solving large scale scientific and engi- 
neering problems on massively parallel distributed 
memory systems. 

IITA activities will focus on: 

-I Application of HPCC technologies to such National 
Challenge areas as health care, lifelong learning, 
digital and electronic libraries, and manufacturing. 

-J Software research relevant to scientific databases, 
digital libraries, collaboration technologies, com- 
puter graphics, and scientific visualization. 

-'Exploring new applications of virtual reality sys- 
tems. 

-I Improvements in accessibility and ease of use of 
Internet-based data and computing. 

-'Research on intelligent knowledge capture, repre- 
sentation, extraction, and dissemination. 
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-I Projects aimed at simplifying human interaction 
with digital information resources through develop- 
ment of user friendly, graphical interfaces for 
knowledge representation and manipulation. 

Activities addressing vital issues of standards. 

-I Development of prototype libraries designed to fill 
new roles in research and education. 



BRHR support will focus on: 

-•Basic research on scalable parallel systems, dis- 
tributed computing environments, and tools. 

Research in fundamental areas of algorithms, 
databases, visualization, architecture, perfor- 
mance evaluation and modeling, and computer 
resource management. 

-« Increased number of postdoctoral awards in high 
performance computational science and engineer- 
ing and computer science, and expansion of the 
current program to include industry. 

-> Continued support for HPCC training and educa- 
tion in the form of research experiences for under- 
graduates, supplements to faculty research 
awards, high school teacher and student training, 
and equipment and infrastructure awards. 

-•Continued acquisition of infrastructure to improve 
computer science, computer engineering, compu- 
tational science and engineering, and Grand 
Challenge research. 
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Department of Energy (DOE) 

DOE'S goals in the HPCC Program are to enable effective applications of HPCC technolo- 
gies and the emerging National Information Infrastructure (Nil) to scientific problems that 
are critical to implementing the Energy Policy Act (PL 102-486), other DOE mission pro- 
grams, and the national interest. DOE's missions encompass such diverse activities as 
energy technologies, studies of energy supply and usage in the U.S., environmental remedi- 
ation, fundamental research, investigations in the health and environmental sciences, and 
national security. 



All five components of the HPCC Program are important 
to achieving DOE's goals. The DOE program for FY 
1994 will continue to build on the foundation of joint 
interagency, interdisciplinary, and private sector collabo- 
rations established during the earlier phases of the 
HPCC Program. 

With its focus on applying HPCC technologies, it is criti- 
cal that the DOE effectively encourage technology trans- 
fer and collaborations among researchers in different 
disciplines and among researchers and their counter- 
parts in U.S. commercial enterprises. In order to ensure 
the effectiveness of this approach, the program: 

J Funds activities in cooperation with other DOE 
mission programs that will develop and use HPCC 
technology. 

-> Involves end users of the technology to the maxi- 
mum extent possible in the initial and ongoing 
evaluation of projects. 

J Carries out work with industrial partners, generally 
through Cooperative Research and Development 
Agreements (CRADAs). 

The Office oi Scientific Computing has been assigned 
the lead responsibility for Department-wide pailicipation 
in the HPCC Program. 



FY 1993 Accomplishments and FY 1994 Plans 
HPCS 

A research program has been initiated to investigate the 
performance of computer systems based on an integrat- 




To better understand combustion pro- 
cesses and the effluent gases produced 
by these processes, hydrogen/air turbu- 
lent reacting flame streams are studied. 
From left tc right, false color renderings 
of the temperature. OH radical concen- 
tration, and NO concentrations are 
shown. Low values are in blue and high 
values in red. (Temperatures in the left 
image range from 30 C to 2,800 C and 
the visible flame is in the red band.) 
The research and object oriented paral- 
lel software are the products of a collab- 
oration among Sandia National 
Laboratory, Lawrence Berkeley 
Laboratory, and the University of 
Cahfornia at Berkeley 
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ed analysis of algorithms used in Grand Challenge 
applications. In addition, a researcher at DOE's Ames 
Laboratory was awarded a patent for developing 
SLALOM, an innovative benchmarking system for any 
type of computer including parallel computers. Two 
large university projects in parallel systems research at 
the University of Illinois and at New York University were 
extended. Several projects have been initiated to evalu- 
ate the effectiveness of early prototype HPCC systems 
on scientific problems important to the DOE at the 
Department's new High Performance Computing 
Research Centers. 



ESnet provides access to Energy 
Research facilities and resources for 
DOE and DOE-supported researchers 
and educators. 



NREN 

Internet Support 

Efforts continue to build on the activities initiated in FY 
1992 and FY 1993. The ESnet FY 1992 fast packet ser- 
vices procurement will provide advanced network capa- 
bilities and services to DOE sites and researchers, in 
addition to accelerating the availability of these public 
telecommunications vendor-based services to other 
Federal, state, and research and education organiza- 
tions. The ESnet is an integral part of the Internet; it 
provides multiprotocol seamless connectivity to scientific 
resources and facilities, for international collaborative 
science, and supports DOE sponsored education activi- 
ties. Other activities and accomplishments include col- 
laborative work in packet video and voice, collaborative 
distributed work environment tools, multiprotocol sup- 
port, GOSIP/OSI to TCP/IP gateways for e-mail and 
other services, and other precompetitive and short term 
research and development efforts. 



Gigabit Research 

DOE participates in the existing gigabit testbeds, the 
development of high speed local area networks (e.g., 
HlPPl), tools needed to support remote experimentation 
and distributed computing, multimedia data manipula- 
tion, high speed network management, and the stan- 
dards associated with each of these technologies. 



ASIA 

Support for Grand Challenges 

DOE set up an interagency panel, comprised of DOE 
program managers and other HPCC agency participarus 
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In work jointly supported by NIH, DOE, 
and NSF, researchers at New York 
University. Sloan Kettering Cancer 
Center, and Oak Ridge National 
Laboratory are elucidating the effects of 
biochemically activated environmental 
chemicals, such as benzo-a-pyrene, a 
material present in automobile exfiaust 
gases, bound to DNA. The figures illus- 
trate calculations of two such deriva- 
tives that are mirror images of one 
another, (+) and (-) antt-benzo-a- 
pyrene-diol-epoxide [BPDEj. bound to a 
segment of normal right-handed DNA. 
There is a profound difference in the 
heallh effects of these two cases, the 
(+) BPDE case {red figure) is tumon- 
genic while the (-) BPDE is benign. 



i and chaired by the NASA HPCC program director, to 
I evaluate proposals for the DOE Grand Challenge com- 
i putational research projects. The selected projects are 
cofunded by other DOE programs and by industrial part- 
ners and include DOE laboratory, university, industry, 
and other HPCC agency participation. The six multi- 
year Grand Challenge projects selected in FY 1992 are: 

; Computational Chemistry - to effectively paral- 

1 lelize chemistry codes Important to the study of 

! several critical environmental problems. This pro- 

I ject is cofunded by four industrial partners and the 

i DOE Chemical Sciences program. 

; -J Computational Structural Biology - for research in 
i computational methods important to understanding 

the components of genomes and to develop a par- 
allel programming environment for structural biolo- 
gy. This project is cofunded by the DOE Health 
j and Environmental Research program, an NSF 
I Science and Technology Center, a biomedical 

I industrial firm, and a university foundation. 

I 

I Mathematical Combustion Modeling - to develop 

i adaptive parallel algorithms for computational fluid 

! dynamics and apply these methods to combustion 

I models important to private sector and govern- 

! ment scientists and engineers. This project is 

I cofunded with the DOE Applied Mathematics and 

i the Chemical Sciences programs. 
I 

; -"Quantum Chromodynamics Calculations - to 

■ develop lattice gauge algorithms on massively par- 

i allel machines. This project is cofunded oy the 
DOE and NSF high energy physics programs and 
involves particle physicists from a dozen universi- 

; ties. 

1 

1 -J Oil Reservoir Modeling - to construct efficient 
! algorithms for parallel systems to simulate fluid 

j flow through permeable media. The work is based 

on reservoir models from the University of Texas 
that are widely used by the oil industry and is 
cofunded by DOE Environmental Sciences, an 
industry consortium of 26 companies, two comput- 
er vendors, NSF, and the State of Texas. 

: JThe Numerical Tokamak Project - to develop and 
! iniegrate particle and fluid plasma models on mas- 

sively parallel machines as part of a multidisci- 
plinary study of Tokamak fusion reactors. The 



project is cofunded by DOE's Fusion Energy pro- 
gram and is an important component of the 
National Energy Strategy. 

By the end of FY 1992 DOE supported 14 computational 
projects. No new computational projects or Grand 
Challenges were started in FY 1993 due to lack of 
funds. In FY 1994, the DOE expects to evaluate the 
existing projects and may initiate new projects to bal- 
ance the program in response to the goals and objec- 
tives of the DOE HPCC Program. 



Software Tools 



Heterogeneous Distributed Conipiitiii}; 



PVM 




The PVM (Parallel Virtual Machine) soft- 
ware permits a heterogeneous collec- 
tion of networked Unix machines (serial, 
vector, or parallel) to be used as a sin- 
gle large parallel computer. This public- 
domain software is now used at hun- 
dreds of sites worldwide. 



Projects were initiated in: object oriented data base 
technology (applied to and cofunded with the 
Superconducting SuperCollider), large spatial databas- 
es, distributed computing technologies, and software 
environments. 



Computational Techniques 

The DOE initiated projects on computational techniques 
applied to catalysis, drug design, and in chemistry and 
the materials sciences in cooperation with private sector 
firms. 



High Performance Computing Research Centers 
(HPCRC) and Advanced Computing Resources 

Two HPCRCs were created in FY 1992, at Los Alamos 
National Laboratory (LANL) and at Oak Ridge National 
Laboratory (ORNL), involving industrial and university 
partnerships as well as cofunding from other DOE pro- 
grams. These HPCRCs conduct research in all HPCC 
Program component areas; operate massively parallel 
high performance computing prototypes (a Thinking 
Machines Inc. CMS at LANL and an Intel Corp. Paragon 
at ORNL); perform computational investigations in glob- 
al climate research, environmental groundwater trans- 
port modeling, and in materials sciences calculations; 
and provide HPCS resources for the other computation- 
al research projects described above. The HPCRC at 
LANL is also a partner in an NSF-sponsored Science 
and Technology Consortium. The Serial #1 Kendall 
Square system was installed at the ORNL HPCRC 
where it will be evaluated on energy applications. 
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A Cray Research Inc. C-90 supercomputer system was 
installed in FY 1993 in the National Energy Research 
Supercomputer Center (NERSC) at Lawrence Livermore 
National Laboratory to provide high performance com- 
puter technology in a full production environment for 
DOE applications. The C-90 has 16 processors and is 
being used in a mode that encourages the use of paral- 
lel programming techniques. 



National Storage Laboratory (NSL) 




Overviev/ of the architecture of the 
National Storage Laboratory located at 
NERSC, in which different networks are 
used for control of the attached devices 
and for data transmission. This archi- 
tecture overcomes the bottleneck m ear- 
lier hierarchical storage designs in 
which all of the data had to pass 
through the control computer. The tech- 
nology will first be used in fusion energy 
and climate modeling applications. The 
NSL architecture is being extended in a 
new High Performance Storage System 
to support scalable parallel I/O and inte- 
gration with massively parallel comput- 
ers. 



In concert with NASA, the NSL was established by a 
CRADA among six industrial firms and NERSC. This 
collaboration currently involves several DOE 
Laboratories, about a dozen U.S. storage vendors, and 
a university. The NSL will help serve the data storage 
needs of researchers at the DOE and at other Federal 
agencies and will help participating vendors develop 
new mass storage products. 

The NSL will advance the state of the art in high perfor- 
mance data storage systems that are capable of storing 
terabytes of data. Such mass storage is required by 
applications such as the Grand Challenges and those 
requiring storage of large amounts of experimental data. 



Candidate IITA Activities 

DOE brings expertise in information technologies to the 
task of developing the Nil. DOE has developed commu- 
nication networks and has applied computing technology 
to a broad range of applications and technical problems 
addressed in collaborations mvolving scientists and 
engineers located across the country as well as around 
the world The many DOE CRADAs are evidence of 
industry's i.uerest in working with the Department. DOE 
Laboratories have a long history of collaborating with 
research universities. 



The early deployment of the Nil is important to the suc- 
cessful implementation of the Energy Policy Act. The 
Nil is critical to the Act's goals of: 

-t Managing energy supply and demand. 

J Developing telecommuting to reduce energy 
usage and provide more efficient use of the 
Nation's human resources. 
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-J Training technical personnel in the use of informa- 
tion technologies. 




"Superkids, " participants in the High- 
School Science Students Honors 
Program, with the National Education 
Supercomputer at NERSC. Each sum- 
mer this program brings one student 
from each state, the District of 
Columbia, Puerto Rico. American 
Samoa, the DOD Dependents Schools, 
and eight foreign students to Lawrence 
Livermore National Laboratory, 



-J Providing energy related information to citizens. 

-J DOE initiatives for energy efficient manufacturing 
and materials processing. 

In FY 1994 a candidate DOE activity is to begin devel- 
oping prototype applications to demonstrate national 
scale applications and use of the Nil in selected energy- 
related areas. It would work closely with corresponding 
programs of other agencies in these efforts. 



BRHR 

DOE supports several educational programs including 
the National Education Supercomputer Program (NESP) 
at NERSC; the Southwest Indian Polytechnic Institute in 
which 30 Native Americans participate; and workshops 
to train teachers in HPCC technology and use, and to 
conduct such workshops themselves. FY 1993 high- 
lights include: 

-J The NESP completed its eighth High School 
Science Students Honors in Supercomputing and 
an associated teachers curriculum development 
workshop, and operated the National Education 
Supercomputer (NES), a Cray X-MP/18 donated 
by Cray Research, Inc. This program was recog- 
nized in a DOE Public Service Award to the 
NERSC Education Coordinator. 

-J A syllabus for teaching computational science at 
the graduate level has been developed and made 
available on the Internet. This work involved 24 
authors from 10 disciplines. It incorporates graph- 
ics using Apple T/laclntosh and IBM RS 6000 tech- 
nologies and allows the user to execute examples 
on Cray Research, IBM, Intel, Kendall Square, 
and Thinking Machines systems. The syllabus is 
maintained at Vanderbilt University. 

-J A Computational Science Graduate Fellowship 
Program was begun in FY 1992. The fellowships 
are awarded on one-year renewable terms to sup- 
port full-time graduate study and thesis research 
in the U.S. The fellowships are in the applied sci- 
ence and engineering disciplines with applications 
in high performance computing. In FY 1993 the 
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number of fellowships was increased to 42 at 35 
universities and institutes. This program and the 
syllabus described above have been instrumental 
in defining the discipline of computational science. 



Fundamental Research Programs 




Clockwise from lower left, volume ren- 
derings display the density of a bubble 
being hit by a shock wave. New adap- 
tive g ridding and fast, accurate, and 
robust numerical algorithms are used to 
simulate the behavior of such highly 
nonlinear fluid flows in complicated 
three-dimensional geometries. These 
techniques are implemented on the lat- 
est vector and massively parallel archi- 
tectures. Applied mathematicians and 
computational scientists performed this 
research at Lawrence Live rm ore 
National Laboratory. Los Alamos 
National Laboratory, New York 
University, and the University of 
California at Berkeley. 



The Applied Mathematics program supports a broad 
range of activities at universities and DOE Laboratories 
in modeling, analysis, and numerical simulation of physi- 
cal and biological phenomena that arise in energy and 
environmental systems. Most of the projects involve 
applications-driven studies of the mathematical and 
numerical tools required to understand the behavior of 
complex discrete and continuous systems with an 
emphasis on algorithms for parallel computing. It has 
cofunded with NSF the Geometry Science and 
Technology Center at the University of Minnesota to 
apply new HPCC technology to traditional mathematics 
problems. It has initiated new efforts in complex nonlin- 
ear behavior that underlies most natural phenomena, 
and in graph and group theories related to discrete phe- 
nomena and topology for application to genome 
sequencing and protein structure. 

In computer science the focus is on understanding how 
parallel and distributed computer systems can be 
applied more effectively to large-scale scientific prob- 
lems. Supported projects include research in program- 
ming models and tools, improved software libraries for 
parallel computers, scientific visualization of large data 
sets, software performance analysis techniques, and 
message-passing utilities to facilitate distributed comput- 
ing. 



FY 1994 Milestones 



HPCS 



Begin evaluating one or two additional early prototype 
systems in cooperation with vendors. 

Expand computer systems performance analysis project, 
including top-down ayorithmic analysis ot Grand 
Challenge codes at HPCRCs. 
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A single frame from an eight month sim- 
ulation for the Pacific Northwest using 
th3 Penn State/NCAR Mesoscale 
Meteorological (MM) model. The simu- 
lation was executed on the Intel 
Touchstone Delta at Caitech. MM 
model results are used in high resolu- 
tion regional forecasts, allowing more 
edicient energy use and helping reduce 
storm damage. Argonne National 
Laboratory (ANL) and NSF-supfjorted 
NCAR researchers used fast fine- 
grained massively parallel software and 
PCN, a parallel programming language 
developed at ANL and Caitech with sup- 
port from the NSF Science and 
Technology Center for Parallel 
Computation. 



Continue development of high performance hierarchical 
data storage system at the NSL in NERSC. 



NREN 

Begin prototype project in telecommuting access to 
DOE experimental facilities. 

Complete ESnet upgrades to 45 Mb/s at 20 sites. 

Initiate ESnet upgrades to 144-622 Mb/s at selected 
sites. 

Continue gigabit research projects, emphasizing dis- 
tributed applications. 

Implement production-quality packetized workstation- 
based video over ESnet and other Internet components. 



ASIA 

Review, evaluate, and adjust program of Grand 
Challenge and computational research projects begun in 
1992. 

Implement fully three-dimensional algorithms based on 
adaptive mesh refinement techniques for computational 
fluid dynamics. 

Deliver prototypes of discipline-oriented computing envi- 
ronments for Grand Challenge applications. 

Conduct Grand Challenge workshop together with other 
HPCC participants, emphasizing progress in software 
tools and computing environments. 

Develop policies, standards, and software engineering 
methodologies to ease the transition of research tools 
into commercial products. 

Develop software to integrate the high performance hier- 
archical data storage system at the NSL into advanced 
computing environments. 

Provide detailed feedback to computer vendors on 
experience gained with prototype computers Installed at 
HPCRCs. 
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Clockwise from the top, a slice of a 
three-dimensional model of an 8 kilome- 
ter/second impact on a planet the size 
of the Earth by a planet the size of 
Mars, at 0. 60, 120. and 200 seconds. 
The gravity of the larger planet later 
traps mantle material and forms a 
moon. Using multidimensional shock 
physics software developed in a collab- 
oration among several DOE 
Laboratories and others under DOE and 
ARPA sponsorship, this is an example 
of materials modeling under extreme 
conditions. The same software is used 
to model other high velocity impact phe- 
nomena, including explosives, resulting 
in fewer experiments, reduced cost, and 
increased safety. 



IITA Candidates 

Publish white paper reviewing applicability of Nil to 
telecommuting and defining the enabling technologies 
required for and the barriers to widespread implementa- 
tion of telecommuting and other forms of telework. 

Evaluate scope of DOE generated information for inclu- 
sion in Nil digital libraries. 

Conduct cooperative evaluation of potential for energy 
supply and demand management using the Nil. 

Begin collaborative development of Nil technologies for 
applications testbeds. 



BRHR 

Refine and make widely available the graduate-level 
computational science electronic textbook. 

Initiate college-level con"iputational science electronic 
textbook. 



Review and evaluate ongoing high school education pro- 
grams and associated teacher workshops. 

Initiate junior high school educational projects. 

Rebalance applied math research program based on 
comprehensive review conducted in 1993. 
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National Aeronautics and Space 
Administration (NASA) 

Improved design and simulation of aerospace vehicles and increased ability of scientists to 
model the Earth's climate and to forecast global environmental trends are NASA's strategic 
goals within the HPCC Program. These goals also include broadening the information appli- 
cations of HPCC in areas complementary to NASA's expertise, and in areas important to the 
development of the National Information Infrastructure. To reach these goals, NASA partici- 
pates in the development and use of the advanced high performance computing and commu- 
nications systems and tools piloted in each of the five components of the HPCC Program. 

HPCS and ASIA: The Grand Challenge in 
Aeronautics 

, Improved design and simulation of advanced aerospace 
; vehicles at reduced cost will enable the U.S. to enhance 
its leadership in aerospace trade, especially as future 
' aerospace vehicles become more difficult and expensive 
to simulate. In the HPCS component, NASA procures 
and evaluates prototype, scalable parallel computing 
systems used to develop advanced algorithms and soft- 
ware tools. This systematic approach is important for 
developing improved methodologies and software tools 
to model aerodynamics, aerobraking, heat transfer, com- 
' 'jstion, and other engine elements through the full flight 
envelope of the aerospace vehicle (from vehicle takeoff, 
to flight at different altitudes and conditions, to landing). 



HPCS and ASTA: The Grand Challenges in the 
Earth's Environment 

NASA's Earth and Space Sciences (ESS) project is 
developing multidisciplinary models of physical, chemi- 
cal, and biological phenomena that will lead to more 
accurate environmental simulations. Challenges range 
from analysis of the interactions among Earth's atmo- 
sphere, oceans, and land masses, to the reconstruction 
of planetary evolution. A crucial aspect of this program 
is the development of software management systems to 
handle the volumes of scientific data that will be pro- 
duced late in this decade; multiple terabytes of data will 
be transmitted and stored each day and will rely on the 
high performance data management, storage systems, 
and communications systems developed through the 
HPCC Program. 




Simulation of three-dimensional distribu- 
tion of the Earth's czone layer. Latitude 
and longitude slices illustrate the vary- 
ing ozone content 




The NASA Aeronautics Network 
(AERONet) provides computer network- 
ing f acuities to the aerospace communi- 
ty. NASA centers are linked via high 
speed communications lines, and 
lower-speed tail circuits connect other 
members of the aerospace community 
to NASA, In addition, AERONet also 
provides Internet access with many 
other networks, thereby increasing 
national and international network con- 
nectivity. 



NASA Science Internet 




NASA Science Internet 



NREN and BRHR: Support for Grand Challenge 
Teams 

NASA has established Grand Challenge applications 
interdisciplinary teams in Computational Aerosciences 
(CAS) and Earth and Space Sciences (ESS). The CAS 
teams are examining coupled aerodynamics, struc- 
tures/materials, controls and combustion modeling for 
high-speed civil transport, high-performance aircraft, 
subsonic aircraft, and rotorcraft. Through a NASA 
Research Announcement, ESS teams have been estab- 
lished in Earth system science, space and solar-terres- 
trial physics, astronomy and astrophysics, biochemical 
life cycles, planetary evolutionary processors, and mas- 
sive data analysis. 

The CAS teams use the NASA Aeronautics Network 
(AERONet) while the ESS teams use the NASA Science 
Internet (NSINet) for high speed network connectivity 
among NASA, industry, and academic researchers (see 
map). In the future, these high performance network 
highways will be constructed from fast-packet network 
technology. NASA supports the architecture evolving in 
the NREN component and participates in the develop- 
ment and deployment of gigabit network technologies 
and architectures. 

Pilot programs with the K-12 educational community 
have been established to discover the best mechanisms 
for using space and aeronautics assets to support edu- 
cational communities in the U.S., and to provide practi- 
r-^' models for using sophisticated computational and 
networking resources in these communities. This is to 
be accomplished in collaboration with Grand Challenge 
scientists from the CAS and ESS projects, thereby 
achieving direct involvement between NASA scientists 
and the K-12 community. 



The NASA Science Internet (NSINet) 
provides connectivity among NASA, 
industry, and academic researchers to 
facilitate collaboration in Earth and 
space science research. This network 
builds on the Internet and includes tech- 
nology to support the evolution of the 
Internet 



ASTA: Software Sharing 

As lead agency in ASTA's software sharing activities, 
NASA coordinates the collection of and access to \he 
software base developed in the HPCC Program. The 
goal of the HPCC Software Exchange is to facilitate the 
exchange and reuse of software. Its specific objectives 
are to 1) develop and demonstrate distributed architec- 
tures and enabling technologies that support software 
exchange, 2) implement an initial distributed HPCC 
Software Exchange that satisfies the needs of the 
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HPCC Program, and 3) specify an open non-proprietary 
architecture that will facilitate the emergence of a nation- 
al software exchange. 




Simulated temperature profile for a 
three-dimensional hypersonic re-entry 
body traveling at an altitude of 1 00 kilo- 
meters, a speed of Mach 24, and an 
angle of attack of W degrees. 
Performed on the Intel Touchstone 
Delta at CSCC, the simulation 
employed 70 million particles and all 
512 of the Delta's processors running 
for 50 minutes. 



IITA: Toward a National Information Infrastructure 

NASA is committed to broadening its participation in key 
areas of research and development of prototype solu- 
tions to National Challenge applications. NASA is selec- 
tively augmenting on-going programs that can contribute 
to an early start-up of these prototype systems in appli- 
cations such as education and lifelong learning, digital 
library technology, manufacturing and industrial design, 
and access to widely available databases of Earth and 
space science data. NASA participates in each of the 
four IITA elements. 



BRHR: Fostering High Performance Computing 
Research 

NASA's BRHR component fosters research into new 
theory and application of high performance computing. 
These activities will leverage current research efforts in 
high performance computing at NASA research insti- 
tutes and universities. 



Major FY 1993 Accomplishments and Activities 



Concurrent SuperComputing Consortium (CSCC) 

NASA played an active role in the Consortium during its 
first year of operation. Use of the Consortium's Intel 
Touchstone Delta supercomputer has enabled major 
advances in several scientific and engineering applica- 
tions including the processing of three-dimensional 
images of Venus taken by the Magellan satellite at the 
rate of four frames per second - thus putting real-time 
image processing within reach. Other accomplishments 
on the Delta include the largest direct numerical simula- 
tion of the time-dependent compressible Navier-Stokes 
equations and the largest three-dimensional compress- 
ible turbulence simulations for high Reynolds numbers. 
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; High Performance Networking 

I 

1 NASA continues to develop and deploy advanced net- 

I working technologies to allow researchers and educa- 

j tors to carry out collaborative research and educational 

I activities. NASA has entered into a cooperative effort 

I with DOE to procure network services that will operate 

; at 45 Mb/s using synchronous optical fiber network stan- 

■ dards. The two agencies are working closely to provide 

; a nationwide fiber optic network that will meet HPCC 

] research communications needs and serve as the foun- 

i dation for even faster networks ranging from 155 Mb/s 

i to eventual gigabit speeds. 



; Software on Parallel Computers 

I NASA's Ames Research Center has ported single disci- 
I pline computational fluid dynamics code to a number of 
j scalable parallel computers. The objective is to perform 
; multidisciplinary optimization of a High Speed Civil 
i Transport vehicle and the takeoff and landing of a sim- 
pie powered lift vehicle (described on pages 126-128 in 
; the Case Studies section). The optimization will consid- 
; er aerodynamic efficiency, structural weight, and propul- 
\ sion system performance. The multidisciplinary analysis 
i will be performed by solving the governing equations for 
each discipline concurrently on a parallel computer. 
; Developing scalable algorithms for the solution of this 
problem will also be central to demonstrating the poten- 
tial for teraflops execution speed on a massively parallel 
I computer. 



High Speed Civil Transport (HSCT) 

NASA's Langley Research Center is working to improve 
the processes for the design and analysis of HSCT 
using advanced computational fluid dynamics and struc- 
tural analyses. A set of highly optimized software tools 
has been created that can be used to implement irregu- 
lar computations on massively parallel machines. 
These tools can be used both manually by users and by 
distributed memory compilers to automatically paral- 
lelize irregular codes. 



Benchmarking Multidisciplinary Codes on Parallel 
Supercomputers 

NASA's Ames Research ' ^ nter has developed and 
84 




The surface pressure distribution on a 
High Spiked Civil Transport aircraft is 
simulated using an Intel iPSC/860 high 
performance computer with 32 proces- 
sors. Areas of highest pressure are in 
red, areas of lowest pressure are dark 
violet. 




Computational fluid dynamics reveals 
the interaction between the freestream 
airflow and engine exhaust of a YAV-88 
Harrier Vertical Takeoff and Landing 
(VTOL) aircraft. The simulation shows 
how hot gas from the nozzles is ingest- 
ed by the engines, reducing their effec- 
tiveness. 



demonstrated the ENSAERO computer algorithm, which 
couples aerodynam ^s and structures analysis modules 
on the Intel iPSC/860 massively parallel computer. 

Results involve the coupling of a low-fidelity structures 
code to a high-fidelity aerodynamics analysis routine. 
This multidibciplinary research, in conjunction with the 
increased performance offered by massively parallel 
computers, will enhance the ability of aircraft manufac- 
turers to quickly analyze different design options and 
accelerate the prototyping process, and thereby reduce 
design cycle costs in addition to producing vehicles with 
improved performance. 



Computational Aerosciences Consortium 

This consortium of U.S. industrial firms works with NASA 
to facilitate the development of precompetitive software 
for the implementation of integrated multidisciplinary 
design, analysis, and optimization systems on heteroge- 
neous computer networks. Incorporation of these sys- 
tems into the product development process can increase 
U.S. competitiveness through reduced design cycle time 
and life cycle costs and increased quality of technology- 
driven products. Consortium members include: 



Allison Gas Turbines 
Boeing Helicopter 
Ford 

General Electric 
General Motors 
Grumman 
McDonnell Douglas 
Northrop 
Rockwell 

United Technologies 
Vought 



High Performance Computing Software Exchange 

The inherent size and complexity of HPCC problems will 
increase the cost and difficulty of developing and main- 
taining robust applications software. The HPCC 
Software Exchange Experiment encourages the sharing 
and reuse of software modules by providing an infras- 
tructure of interconnected software repositories. The 
HPCC Software Exchange Experiment System repre- 
sents the first time that a number of different agencies 
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with different philosophies for software management have 
collaborated to develop an integrated, albeit experimental, 
system. 

The second phase of development, the HPCC Software 
Exchange Prototype System, was begun in FY 1993. 
This phase includes the development of 1) an HPCC 
Software Standards database with initial software submis- 
sion standards, 2) an HPCC Repository Directory with 
additional software repositories, 3) an HPCC Union 
Catalogue populated with mathematical and statistical 
software packages and programs, 4) a Mathematical and 
Statistical Software Cross-index, and 5) a Unix-to-Unix 
client/server system for uniform repository access. 



FY 1994 Milestones 
HPCS 

Install 20- to 50-gigaops testbed (scalable to 100- 
gigaops) for Computational Aerosciences (CAS) project 
Grand Challenge teams. 

NREN 

Complete T3 (45 Mb/s) Level 3 interconnects to NASA 
HPCC Centers and T3 Level 2 interconnects among 
NASA HPCC Centers, 



BRHR 

Evaluate initial K-12 digital educational material. 
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National Institutes of Health (NIH) 

The National Institutes of Health (NIH) contribution to the HPCC Program focuses on 
biomedical applications of computing and digital communications. Four NIH units have 
HPCC programs: 

NLM - National Library of Medicine 
NCRR - National Center for Research Resources 
DCRT - Division of Computer Research and Technology 
NCI - National Cancer Institute 



NIH participates in each of the five components of the 
overall Federal HPCC Program, as follows: 




A coss-section of the three-dimensional 
reconstruction of a herpes simplex virus 
cap Sid is shown in the inset with the 
monoclonal antibody fragments bound 
to the protruding tips of hexons color- 
coded red and the original electron 
micrograph shown in the background. 



HPCS: Evaluation for Biomedical Applications 

Through DCRT, NCI, and NCRR, NIH applies a.i eval- 
uates scalable parallel computing systems to problems 
of biomedical significance. This includes adapting exist- 
ing molecular analysis algorithms to new computing 
architectures, and developing entirely new approaches 
that take advantage of computational parallelism. 



NREN: Increasing Access and Transmitting 
Biomedical Images 

DCRT and NLM have complementary investments in 
extending gigabit speed communications for high data 
volume scientific applications, as well as lower speed 
connections for a broad community of research and edu- 
cation institutions. 

DCRTs efforts focus on high speed networking to sup- 
port the intramural research program of the NIH; NLM 
serves as a national resource, providing support for 
medical centers to connect to the Internet, and develop- 
ing prototype biomedical digital image libraries that use 
the Internet as a high speed distribution channel. An 
Intelligent Gateways project, co-sponsored by NLM and 
NSF, is developing methods to link dissimilar databanks 
over the internet, using automated "Knowbots" 
(Knowledge Robots), 
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I ASTA: Molecular Biology and Biomedical imagery 



i Each of the four NIH organizational units is developing 
algorithms and software for advanced, high performance 

; computing environments. The two major themes of this 

. work are molecular biology and biomedical imaging. 

, Molecular biology computing includes comparison of 
genetic and protein sequences, and early development 

; of algorithms to predict molecular structure and function. 

: Biomedical imaging includes imaging of molecules and 

: new methods for correlating and displaying clinical 

; images in three dimensions. 

IITA: Applications For Improved Health Care 
Delivery 

; In FY 1994 NIH will support the development of HPCC 
technologies for health care, with particular emphasis on 
i the following applications: 

-iJestbed networks for linking hospitals, clinics, 
doctors' offices, medical schools, medical libraries, 
and universities to enable health care providers 
and researchers to share medical data and 
imagery. 

' -> Software and visualization technology for visualiz- 
ing the human anatomy and analyzing imagery 
from X-rays, CAT scans, PET scans, and other 
diagnostic tools. 

-i Virtual reality technology for simulating operations 
and other medical procedures. 

""Collaborative technology to allow several health 
care providers in remote locations to provide real- 
time treatment to patients. 

J Database technology to provide health care 
providers with access to relevant medical informa- 
tion and literature. 

J Database technology for storing, accessing, and 
transmitting patients' medical records while pro- 
tecting the accuracy and privacy of those records. 

Two to five research and development projects in each 
of these areas will be supported via an NIH Broad 
Agency Announcement contract mechanism issued in 
FY 1993. 
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The myoglobin protein with a hydration 
of 350 water molecules. 



I BRHR: Medical Informatics Fellowships and 
i Biotnedlcal Science Education 

NIH provides training and an ongoing investment in fun- 
damental technology development, NCRR and NLM 
1 both sponsor formal degree-granting fellowship training 
t in medical informatics, and cross-disciplinary training of 
I established investigators in the use of advanced com- 
! puting systems and methods, NCRR also supports a 
I pilot project to educate high school science teachers and 
I their students about new computing technologies for 
' biomedical science. 



i FY 1993 Accomplishments 



; HPCS: Evaluation of Parallel Systems 

j DCRT evaluated a 128 processor Intel Touchstone 

! Gamma Prototype Parallel Computer and associated 

i system software on biomedical problems in structural 

j biology, computational chemistry, image processing, and 

; genetic database searching. 

; DCRT designed and implemented remote file access 
and communication systems software for this computer. 

. NCRR funded a Kendall Square Research KSR-1 com- 

[ puter jointly with NSF and ARPA at the Cornell Theory 

\ Center, and is evaluating its efficiency and effectiveness 

i for biological problems. 

j 

j NREN: Medical Connections Program 

i NLM initiated a Medical Connections program in collabo- 

i ration with NSF, to provide support for academic medical 

j centers to connect to the Internet. In addition, NLM has 

I provided support for a pilot project to connect rural hos- 

j pitals in the Northwest to the Internet. This project is 

' coordinated by the University of Washington Health 
Sciences Center Library, a Reg.onal Medical Library in 

i the National Network of Libraries of Medicine. 

I 

I NREN: Access to X-ray Images 

; NLM began developing a system to provide Internet- 

; mediated access to an electronic archive of 20,000 digi- 

' tal X-ray images for medical research purposes. 
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NREN: UMLS Research 

NLM created and published on CD-ROM a prototype 
Metathesaurus, Semantic Network, and Information 
Sources Map as part of the Unified Medical Language 
Systems research effort to link together computer-based 
biomedical information resources. These data files sup- 
port experimentation on advanced systems that trans- 
late user information requests into multiple access 
vocabularies. 



NREN: Digital Anatomy Demonstration Project 

NLM initiated a demonstration project that will create a 
digital anatomy workstation that allows a health profes- 
sions student to browse three-dimensional images gen- 
erated by a specialized graphics computer at a distant 
site. The prototype links the NLM's Learning Center for 
Interactive Technology in Bethesc^a to the University of 
Washington at Seattle via the internet. 



NREN: Access to Cancer Treatment Guidelines 



High performance systems under 
evaluation for biomedical appli- 
cations 
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NCI implemented remote file access to treatment guide- 
lines from its PDQ (Physician Data Query) database via 
the Internet. 



ASTA: Parallel Methods for Biomedical 
Applications 

NCRR-supported High Performance Computing 
Resource Centers are evaluating high performance sys- 
tems for biomedical research applications (see Side 
Bar). Investigators at these Centers have developed 
applications including: 
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J Modeling the molecular dynamics of proteins in 
membranes, in order to enable the study of drug 
permeability across membranes. This requires 
simulating approximately 10,000 atoms in a mem- 
brane patch. 

J Simulating the complex interactions between DNA 
and protein (specifically Eco Rl, a restriction 
enzyme). This work won the 1993 Computerworld 
Smithsonian Award. 
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Calculation of the binding of small 
molecules to DNA and other biological 
macromolecules depends upon a com- 
plex interaction of electrostatic fields, 
solvent-accessible surface, and other 
physicochemical properties. Structute- 
based drug design is a key biomedical 
HPCC Grand Challenge. 



-J Developing a "dynamical model" for the structure 
of proteins essentia! for the replication of the 
human immunodeficiency virus 1 (HIV-1), which 
may help in generating inhibitors of the proiein. 

-J Determining the three-dimensional structure of 
proteins by developing algorithms that model how 
proteins fold based on their amino acid 
sequences. 

-I Modeling the ability of molecules to bind to target 
receptors in solution by calculating their "solvation 
energies." This is a crucial component of rational 
drug design. 

DCRT developed parallel methods for the following 
biomedical applications: 

-"The three-dimensional reconstruction of herpes 
virus images from two-dimensional projections of 
the virus obtained from electron micrographs. 

-"The calculation of the solvent accessible surface 
area of proteins that is used to predict the confor- 
mation of these molecules. 

-J The generation of primary sequence patterns from 
sets of related protein sequences contained in a 
database. 

J The within-subject registration of PET (Positron 
Emission Tomography) images for the correction 
of roll, yaw, pitch, and translation. 

-iThe processing of NMR (Nuclear Magnetic 
Resonance) spectroscopy data using the 
Maximum Entropy Method for determining the 
structure of proteins. 

-lAb initio quantum mechanical calculations for 
molecules of biological interest. 

-"Molecular dynamics calculations with a parallel 
implementation of CHARMM, a molecular model- 
ing program that takes atomic coordinates or 
molecules and renders graphical images of those 
molecules that can be manipulated in various 
ways for experimental chemistry. 




Two-dimensional clinical images from 
computed tomography and magnetic 
resonance imaging underpin modern 
medical diagnosis. Transmission of 
these diagnostic images over v/ide area 
networks and their reconstruction to 
form three-dimensional views are impor- 
tant health care applications of HPCC 
technologies. 
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^ Human genetic linkage analysis to deternnine the 
likely position of a disease gene using LINKAGE, 
a gene linkage analysis progrann that calculates 
the probability of the association between a pat- 
tern of gene inheritance and a disease condition. 
It is used to analyze fannily pedigrees based on 
data obtained fronn gene probes. 



ASTA: "Visible Human" 

NLM initiated a two-year project to acquire the three- 
dinnensional digital representation of entire hunnan 
beings at nniliinneter-level resolution, derived fronn com- 
puted tomography, magnetic resonance imaging, and 
digitized cryosections. This "Visible Human" research 
data set will become available nationally via the Internet 
in 1994. 



ASTA: Prototype Program for Retrieving Molecular 
Biology Information 

NLM created a prototype advanced molecular biology 
information retrieval program that provides integrated 
access to genetic and protein molecular sequences, and 
the biomedical literature linked to those sequences. 
Field testing of the system has begun. 



ASTA: Faster Molecular Analysis and Imaging 
Algorithms 

NCRR and NLM achieved order of magnitude speedups 
in several existing molecular analysis algorithms. 

DCRT and NCRR developed new algorithms for regis- 
tration and rendering of three-dimensional images from 
two-dimensional clinical images and micrographs. 



ASTA: HIV Research 

Research conducted at NCI's Biomedical 
Supercomputer Center is increasing the understanding 
of the human immunodeficiency virus (HIV) that causes 
AIDS and is helping to design and develop new drugs to 
combat the deadly disease. NCI researchers have suc- 
cessfully predicted the secondary structure of the entire 
9,000 unit HIV virus RNA. NCI and NCRR supercom- 
puting applications have assisted in the design of new 
drugs to inhibit HIV replication. 
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Digital radiology techniques require high 
speed networks: a single X-ray film rep- 
resented by a 2K-by-2K-by-10 btt gray 
scale generates a 4 megabyte image 
file. 
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BRHR: Medical Informatics Grants and Other 
Training 

NLM competed the award of 10 Medical Informatics 
Training Grant programs at academic medical centers. 
The program supports cross-disciplinary training of 
health professionals in the use of advanced computing 
technologies. 

NCRR conducted a pilot project to introduce scientific 
computing methods to high school science teachers and 
their students. 

DCRT and NCRR sponsored "hands on" training of 
biomedical researchers in the use of new computational 
biology tools at NSF Supercomputer Centers and on the 
NIH campus in Bethesda. 



BRHR: Basic Research Through Long Distance 
Microscopy 

In the first demonstration of its kind, scientists at a work- 
station in Chicago viewed high-resolution images of 
nerve cells in a high-voltage electron microscope located 
1,700 miles away at the San Diego Microscopy and 
Imaging Resource (SDMIR), which is supported by 
NCRR. Further details are given on pages 123-125 in 
the Case Studies section. 



FY 1994 Milestones 

NIH will accelerate the pace of molecular and genetic 
discovery by enabling the solution of currently intractable 
problems in molecular structure prediction, drug design, 
and human genome database analysis. 

The program will apply and evaluate new computer 
architectures to key problems of human health and dis- 
ease, in a manner that gives early feedback to computer 
designers on the strengths and limitations of their sys- 
tems for medical applications. The HPCC Program will 
rapidly build an electronic community among life science 
researchers by connecting academic medical centers to 
the Internet. It will create prototype medical imaging 
applications that use the Internet and provide a model 
for distance-independent medical consultation. It will 
double the pool of computationally trained investigators 
in biomedicine. 
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HPCS: Evaluation of Parallel Systems 

DCRT will obtain a next generation parallel computer 
that will allow the solution of new computationally inten- 
sive problems in biomedicine. 

NCRR will assess the efficiency and scalability of 
emerging massively parallel architectures for Grand 
Challenge problems. 



X-ray diffraction spectroscopy is a labo- 
ratory method for determining the folded 
structure of proteins and other biological 
macromolecules. Parallel computing 
systems can be used to automate inter- 
pretation of X-ray diffraction patterns 
acquired via two-dimensional array sen- 
sors. 



NREN: More Connections to the Internet 

NLM will establish Internet connections to 70 to 100 
additional medical centers. 



NREN: Digital Anatomy Databases 

NLM will create advanced three-dimensional imaging 
databases for digital anatomy on the Internet by the 
nation's health professions schools. Workstations to 
access and display those images will be developed. 



NREN: "Knowbots" for Natural Language Queries 

An operational Knowbot-based database retrieval sys- 
tem will be deployed at NLM to provide integrated 
access to over 50 computerized knowledge sources in 
biomedicine, underpinned by a fully operational Unified 
Medical Language System that allows users to state sci- 
entific questions in their own language, and have the 
answer retrieved and synthesized automatically from 
multiple databases at multiple sites on the Internet. 



ASIA: Software Development and Hardware 
Placement 



NCI will expand its advanced software development pro- 
gram to allow research on a broader range of molecular 
dynamics, structure-function problems, and structure- 
assisted drug design. 

NLM will develop and deploy advanced molecular biolo- 
gy workstations to approximately 1,000 molecular biolo- 
gy laboratories. 

Through funding of five biomedical High Performance 
Computing Resource Center (HPCRC) programs at 
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NSF and ARPA-sponsored high performance computing 
centers, NCRR will support development of algorithms to 
compare molecular sequences, predict molecular struc- 
ture from genetic and protein sequences, simulate pro- 
tein folding, and model complex biological systems such 
as proteins interacting with membranes in an aqueous 
solution. Computed images of biological structure, from 
molecular to whole body, will be an additional area of 
ASIA software development. 



IITA: Health-Related Research and Development 

NIH will support the development of HPCC technologies 
through a Broad Agency Announcement to support two 
to five research and development projects in each of the 
six health-related areas listed above. 

NCI will provide Xconf, a prototype multimedia (including 
medical images) group conferencing tool that uses the 
Internet. Contingent on fundit^g, NCI will 1) connect to 
the Internet both medical research centers (to facilitate 
multicenter environmental epidemiology studies) and the 
Cancer Information Service offices at its cancer centers, 
and 2) begin developing telemammography over high 
speed networks. 



BRHR: New and Upgraded Centers and Additional 
Fellowships 

In order to meet the neeas of biomedical researchers, 
NCRR will establish at least one additional high perfor- 
mance computing resource center and upgrade the five 
existing centers. Enhanced cross training of biomedical 
research scientists will also be possible. 

NLM will fund an additional 50 medical informatics train- 
ing fellowships nationwide. 
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National Security Agency (NSA) 

The goal of NSA's HPCC Program is to accelerate the development and application of the 
highest performance computing and communications technologies to meet national security 
requirements and to contribute to collective progress in the Federal HPCC Program. 



In support of this goal, NSA: 

-J Develops algorithms and architectural simulators 
and testbeds that contribute to a balanced environ- 
ment of workstations, vector supercomputers, 
massively parallel computer architectures, and 
high speed networks. 

-I Sponsors and participates in basic and applied 
research and development of gigabit networking 
technology. 

-"Develops network security and information securi- 
ty techniques and testbeds appropriate for high 
speed in-house networking and for interconnection 
with public networks. 




By integrating processing directly into 
otherwise standard memory chips iabri- 
cated at its Special Processing 
Laboratory, the Supercomputing 
Research Center has developed the 
Tcrasys workstation, which outperforms 
one Cray Y-MP processor by 5 to 48 
times on a set of nine NSA applications. 
A mature software environment, avail ^ 
able for the workstation, makes the sys- 
tem easy to use. 



-J Develops software and hardware technology for 
highly parallel architectures scalable to sustained 
teraops performance. 

Investigates or develops new technologies in 
materials science, superconductivity, ultra-high- 
speed switching and interconnection techniques, 
networking, and mass storage systems fundamen- 
tal to increased performance objectives of high 
performance computing programs. 



NSA participates in all five components of the HPCC 
Program as follows. 



HPCS: Heterogeneous High Performance 
Computing; Balanced Architectures 

NSA deploys experimental scalable computer capabili- 
ties, emphasizing interoperability of massively parallel 
nachines in a highly heterogeneous environment of 
workstations, vector supercomputers, and mass storage 
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devices. NSA's HPCS program also emphasizes an 
open systems approach to development and mainte- 
nance of the HPCC environment and the integration of 
specialized high speed hardware within this environ- 
ment. 



NREN: Network and Security Technology 

NSA uses the Internet to provide high speed network 
connection among NSA, industry, and academic 
researchers. NSA takes the lead in developing network 
security and other information system security technolo- 
gy and products for high speed networks. It establishes 
high speed network testbeds to explore network and 
security interface technology issues. 



5 



ASIA: High Performance Systems Software, Tools, 
and Algorithm Research 

NSA develops systems software to enhance productivity 
of users of high performance systems. This software 
includes compilers, simulators, performance monitoring 
tools, software that is portable among a variety of high 
performance systems, software for distributing jobs 
across a network, and visualization tools. New algo- 
rithms are developed to map problems to high perfor- 
mance architectures. 



Time improvement using multiple pro- 
cessors vs. a single processor for a par- 
allel eigensolver algorithm for large 
dense symmetric matrices, which occur 
frequently in models of physical phe- 
nomena. A parallel algorithm "scales 
well" when it effectively uses almost all 
available resources as the problem size 
and the number of processors increase. 
The achievable performance improve- 
ment is proportional to the increase in 
the number of processors. Parallel 
algorithm design and implementation is 
an iterative process with the goal of 
achieving the maximum performance 
possible. SRC research continues 
seeking ever-faster eigensolvers. 
These data are from the Intel 
Touchstone Delta at Caltech. Results 
are being collected for the IBM SP1, the 
Thinking Machines CM5. and the Intel 
Paragon. 



IITA: Development of D'jal-Use Technology 

NSA proposes to investigate developmental technolo- 
gies to support infornr.ation infrastructure applications in 
manufacturing, education, public health, and digital 
libraries. Research and development in transaction pro- 
cessing, database management systems, and digital 
data storage and retrieval systems, are expected to 
make strong dual-use technology contributions to both 
the Federal and the IITA communities. 



BRHR: Fundamental High Performance System 
Research and Education 

NSA supports basic research into new technologies, 
theory and concepts of high performance computing and 
networking, and promotes research in high performance 
computing at the Institute for Defense Analyses' (IDA) 
Supercomputing Research Center (SRC) and at univer- 
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sities. NSA's National Cryptologic School and the SRC 
develop courses suitable for users of high performance 
computing environments. 



Management 

The overall coordination of NSA's HPCC activities 
resides in the office of the NSA Chief Scientist, who 
reports to the Director of NSA. Responsibilities for exe- 
cution of major elements of the plan lie with the 
Technology and Systems Directorate and the 
Information Systems Security Directorate. NSA spon- 
sors the SRC in exploring massively parallel computer 
architectures and in developing algorithms and systems 
software for parallel and distributed systems. The SRC 
heavily supports NSA's HPCC activities directly and by 
collaborative efforts with other HPCC participants, espe- 
cially industry and academia. 



FY 1994 Plans 



Memory traffic flow from CPU memory 
ports through a memory arbitration net- 
work, and back to CPU input ports. 
Each colored rectangle represents one 
physical queue organized in groups. 
The colors represent the queue state: 
for example an empty queue is white 
and a full queue is red. The animation 
of this display shows memory message 
traffic through the mem ^/y network. Its 
purpose is to point out possible clogs 
and busy spots within the network. 



HPCS 

Extend existing high performance system simulators and 
testbeds at NSA and the SRC. 

Develop mass archival storage - 10^^ to 10^^ bits. 

Define techniques for the interoperability of distributed 
operating systems spanning large sets of heterogeneous 
computer assets, including supercomputers. 

integrate major new vector/scalar massively parallel pro- 
cessor as a research system. 

Demonstrate a terabit/second (10^^-bit-operations-per- 
second) deskside SIMD system. 

Continue technical cooperation with major vector/mas- 
sively parallel processor developers. 

Investigate, cooperatively with industry, processing-in- 
memory (PIM) technology in established systems archi- 
tectures. 
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Front and rear views of High Speed 
Network (HNET) Testbed. 

These 64 Unix processors attached to 
64 custom-chip switch nodes, each with 
seven ports, serve as a high speed net- 
work routing protocol testbed. The sys- 
tem can be configured to be an 
Asynchronous Transfer Mode (ATM) 
switch, for example, to allow experimen- 
tation with the efficiency of currently 
evolving commercial offerings. 



NREN 

; Install in-house gigabit network testbed to :xp!ore high 

I speed network architectures and techniques. 

I Explore network security issues for 622 Mb/s and 2.4 

I Gb/s networks. 

' Install a gigabit network testbed to explore compatibility 

I of DOD networks with vendor-provided public networks. 

' Initiate development of a bulk link encryptor for high 

I speed networks. 

; Develop proof of concept for cell encryption in very high 

■ speed switched network products. 



i ASIA 



j Develop parallel extensions to high-level programming 

I languages suitable for parallel architectures. 

I Develop visualization techniques for performance analy- 

I sis of parallel and vector high-performance architec- 

i tures. 



! Develop system modeling tools for heterogeneous com- 

[ puting environments, including high performance sys- 

I tems. 

i Develop algorithms and implementations for solving 

) eigensystems and manipulating sparse matrices on par- 

i allel systems. 



Develop evaluation testbed for exploring routing algo- 
rithms and topologies for computer interconnects. 



IITA Candidates 

Study applicability of heterogeneous data base technol- 
ogy program to information infrastructure application 
needs. 

Investigate transferability of digital library technology to 
the private sector. 

Researcn public sector security technology issues 
unique to the IITA as well as dual-use technologies 
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NSA has used parallel processing to 
greatly accelerate workstation perfor- 
mance. Designed and fabricated at the 
SRC, this board employs 32 Field 
Programmable Gate Arrays which are 
custom programmed for each applica- 
tion. This customization and paralleliza- 
tion yields speedups of 100 to 1,000 
times the already impressive worksta- 
tion performance. (Field Programmable 
Gate Arrays are also described on 
pages 154-155 in the Case Studies sec- 
tion.) 



applicable to both national security and public sector 
communities. 



BRHR 

Initiate collaborative and university research efforts in 
performance modeling of high performance computing 
systems for generic problem domains. 

Explore innovative parallel computer and network archi- 
tectures. 

Investigate new technologies in material sciences, 
superconductivity, optoelectronics, ultra-high-speed 
interconnection, and switching. 
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National Institute of Standards and 
Technology (NiST) 

High performance computing and communications technology is an essentia! enabling com- 
ponent of NIST's mission to promote U.S. industrial leadership and international competi- 
tiveness and to provide measurement, calibration, and quality assurance techniques to sup- 
port U.S. commercial and technological progress. The objectives of NIST's HPCC program 
are: to accelerate the development and deployment of high performance computing and 
networking technologies required for the National Information Infrastructure; to apply and 
test these technologies in a manufacturing environment; and to serve as coordinating agen- 
cy for the manufacturing component of the Federal Program. 



Specific goals of NIST's program are: 




NISTs MultiKron chip provides low per- 
turbation measurements for perfor- 
mance evaluation of computer and com- 
munication systems. 



-J To apply high performance communications and 
networking technology to promote improved U.S. 
product quality and manufacturing performance, to 
reduce production costs and time-to-market, and 
to increase competitiveness in international mar- 
kets. 

-iTo promote the development and deployment of 
advanced communications technology to support 
the education, research, and manufacturing com- 
munities and to increase the availability of scientif- 
ic and engineering data via the National 
Information infrastructure. 

-J To advance instrumentation and performance 
measurement methodologies for high performance 
computing and networking systems and compo- 
nents to achieve improved system and application 
performance. 

-J To develop efficient algorithms and portable, scal- 
able software for the application of high perfor- 
mance computing systems to industrial problems, 
and to develop improved methods for the public 
dissemination of advanced software and docu- 
mentation. 



-J To support, promote, and coordinate the develop- 
ment of voluntary standards that provide interoper- 
ability and common user interfaces among sys- 
tems. 
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; NIST participates in four components of the HPCC 

! Program: 

! 

I 

I HPCS: Performance Measurement of Scalable 
: Systems 

j 

; NIST develops instrumentation and nnethodology for 

I performance measurement of high performance net- 

j works and massively parallel computer systems. 

; Emphasis is on the use of low-perturbation data capture 

I hardware and simplified software-based approaches to 

\ performance characterization. 



[ NREN: Networking and Information Infrastructure 

; NIST supports and coordinates the development of 

, standards within the Federal government to provide 

• interoperability, common user interfaces to systems, and 

1 enhanced security. NIST works with other agencies to 

; promote open system standards to aid in the commer- 

; cialization of technology by U.S. industry. NIST pro- 

\ motes the development of communications infrastruc- 
ture and the use of the Internet through information 

' technology research, development, and related activities 

: to enhance basic communications capabilities. 




A computer-controlled coordinate mea- 
suring machine determines the exact 
dimensions of a precision-machined 
stainless steel part. NIST researchers 
use this and similar instruments to 
devise ways to improve machine tool 
performance. 



ASIA: Application Systems and Software 
Technology 

NIST develops algorithms and generic software for 
advanced scientific, engineering, and manufacturing 
applications. Common elements and techniques are 
encapsulated in software libraries to promote ease of 
use and application portability. NIST's Guide to 
Available Mathematical Software (GAMS) provides 
industry and the public with improved electronic access 
to reusable software. 



IITA: Systems Integration for Manufacturing 
Applications 

NIST will build upon its experience in information tech- 
nology and manufacturing engineering to accelerate the 
application of high performance computing and commu- 
nications technology to manufacturing environments. 
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NIST will support expanded programs in advanced man- 
ufacturing systems integration technologies; develop- 
ment and testing of prototype components and interface 
specifications for manufacturing systems; application of 
high performance computing and networking technolo- 
gies to integrate design and production processes; and 
testbads for achieving cost-effective application of 
advanced manufacturing systems and ne^//orks. 



FY 1993 Accomplishments and FY 1994 Plans 




I 



A machinist monitors a machine tool 
retrofitted with a personal computer 
controller. The machine is located in 
NISVs Shop of the 90s where manufac- 
turers can learn how to use open sys- 
tem integration technology and low-cost 
automation techniques to improve pro- 
ductivity and product quality. 



Systems integration for Manufacturing Applications 

Beginning in FY 1994, NIST will establish an Advanced 
Manufacturing Systems and Networking Testbed to sup- 
port research and development in high performance 
manufacturing systems and to test high performance 
computer and networking hardware and software in a 
manufacturing environment. The testbed will serve as a 
demonstration site for use by industrial technology sup- 
pliers and users, and to assist industry in the develop- 
ment and implementation of voluntary consensus stan- 
dards. Research and testing will be co.iducted at the 
NIST testbed as well as at testbeds funded through the 
NIST Advanced Technology Program. A manufacturing 
systems environment will be developed to support the 
integration of advanced manufacturing systems and net- 
working software and products. A standards-based data 
exchange effort for computer integrated manufacturing 
will focus on improving data exchange among computer 
aided design, process, and manufacturing activities. 
Prototype systems and interface specifications will be 
communicated to appropriate standards organizations. 
Results will be made available to U.S. industry through 
workshops, training materials, electronic data reposito- 
ries, and pre-commercial prototype systems that can be 
installed by potential vendors for test and evaluation. 
One role of advanced computing technology in manufac- 
turing process modeling and simulation is described on 
pages 150-151 in the Case Studies section. 



Networking and Information Infrastructure 



NIST performance evaluation activities include measure- 
ment and characterization of the impact of software pro- 



id 

ERLC 



103 



1 17 




Since the early 1970s, NIST has been 
developing cost-effective ways to help 
protect computerized data. NIST has 
devised a prototype system for control- 
ling access to a computer system that 
uses a password, a smart card, a finger- 
print reader, and cryptography. 



tocols on communication performance in order to mini- 
mize communication bottlenecks between application 
programs. NIST researchers have implemented a high 
speed communications testbed that provides a HlPPl 
link to a performance instrumented workstation. 
Testbed performance instrumentation includes a modi- 
fied NIST MultiKron performance data capture chip 
interfaced to the test workstation. The workstation 
HlPPl interface was designed, implemented and 
obtained through a collaborative effort with the 
VlSTANet project, one of the NREN gigabit testbeds. 

In FY 1994. NIST will employ systems instrumented with 
the MultiKron chip to investigate the behavior and per- 
formance of communications protocols suitable for multi- 
gigabit/second transmission rates. For high perfor- 
mance networking, NIST will support transition planning 
and deployment of ISDN and OSl-based protocols in the 
Internet and undertake research and development activ- 
ities to support emerging Broadband ISDN standards. 
NIST will continue to interact with industry by sponsoring 
and hosting the North American ISDN Users Forum. 

N!ST activities in the areas of networking and communi- 
cations technology will be expanded to address applica- 
tions of information infrastructure including electronic 
commerce, distributed multimedia environments, and 
adaptive systems. Support for electronic commerce will 
focus on enabling electronic exchange technology and 
protocols to support business transactions and manu- 
facturing techniques. NIST will develop improved elec- 
tronic data interchange methodology to describe, 
access, and update data, in FY 1994, an integration 
facility will be created for manufacturing applications of 
electronic commerce. 

NIST activities in distributed multimedia environments 
will include the development of methodology to acquire 
and administer the large amounts of text and multimedia 
material associated with electronic libraries and the 
implementation of information retrieval mechanisms for 
easy access to information by untrained end users. 
NIST activities in adaptive systems will include research 
in wireless communication compression and encoding 
technology. NIST will also conduct workshops to 
assess network security requirements and develop net- 
work security technology suitable for Internet and other 
networking technologies. 
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Performance Measurement 

NIST developed the MultiKron chip to achieve low-per- 
turbation data capture while assessing the performance 
of scalable high performance computer systems. This 
technology was transferred to Intel Corporation for appli- 
cation in its Paragon systems. NIST also devised a soft- 
ware-based technique for portable sensitivity measure- 
ments of parallel programs. The new method is based 
upon statistical experimental design principles and 
applies to any MIMD system. A low-cost setup 
approach makes the technique practical, and promising 
preliminary results on shared-memory and distributed 
memory systems have been obtained. 

In FY 1994, NIST will extend its hardware and software 
tools for system performance monitoring through the 
acquisition of a MultiKron instrumented scalable system. 
Evaluation activities will focus on the performance char- 
acterization of application programs running on this sys- 
tem and on other scalable systems. 




statistical analysis of video microscope 
images provides improved precision in 
determining optical fiber geometry. 



Software DeveioH>^ 3nt, Distribution, and Reuse 

The NIST Guide to Available Mathematical Software 
(GAMS) project develops techniques and tools to help 
scientists and engineers locate and use computer soft- 
ware to solve mathematical and statistical problems. 
The GAMS system has been incorporated in the 
Software Exchange Experiment coordinated by the 
NASA Goddard Space Flight Center. The status of 
GAMS and future plans are described on pages 148-149 
in Case Studies section. 

In FY 1994, NIST algorithm and software development 
activities will address needs for improved computational 
performance and visualization capability in application 
areas drawn from biotechnology and from chemical and 
materials process design and simulation. 
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National Oceanic and Atmospheric 
Administration (NOAA) 

NOAA's Grand Challenge research in climate prediction and weather forecasting is critical 
to its mission to describe and predict changes in the Earth's environment, manage the 
Nation's ocean and coastal resources, and promote global stewardship of the world's 
oceans and atmosphere. This research depends on advances in high-end computing and 
on the collection and dissemination of environmental data. 



NOAA Grand 
Challenges Requiring 
HPCC Resources 



• Environmental assessment and 

prediction 

- Global and regional modeling 
to support short term 
forecasting and warnings 

Weather 

River flow and water 
resources 

Solar and space 

Living marine resource 
forecasts 

- Assessment of seasonal, 

interannualy and long-term 
global environmental change 

Global change modeling 

Ocean modeling 

Coastal analysis and assess- 
ment 

• Environmental data and 

information dissemination 

- Climate and weather 

- Oceanographic 

- Geophysical 

- Na)?igationaU including 
charts of U.S. waters and 
airspace 



Increased computing power will enable higher resolution 
in the current models of the Earth's atmosphere-ocean 
system. Increased resolution will enable accurate repre- 
sentation of key features such as weather fronts and 
ocean eddies, and eliminate distortions due to clouds. 
More accurate NOAA models will improve the under- 
standing of the behavior of climate and weather sys- 
tems, making possible better decision making by gov- 
ernment and industry on issues that affect both the envi- 
ronment and the economy. 

NOAA is the Federal agency responsible for archiving 
and disseminating the Nation's environmental data, and 
is the principal repository for the Nation's climatic data 
for the U.S. Global Change Research Program. By 
increasing NOAA connectivity to the Internet, 
researchers and other users will have better access to 
this growing collection of large data sets located at more 
than a score of sites. 

Through HPCC efforts in climate modeling, NOAA will 
provide better simulations of atmosphere-ocean coupling 
and a first-ever direct attack on the regional climate 
change problem. More accurate and more timely 
assessment of the future impact of climate change will 
make it possible to avoid "false choices" between the 
economy and the global environment. In weather fore- 
casting, finer resolution in global and regional models 
will result in better weather forecasting and warning ser- 
vices, especially for hazardous weather and flight safety. 



NOAA participates in the NREN, ASTA, IITA, and BRHR 
components of the HPCC Program as follows. 
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NREN: Irrjproving Access to Systems and Data 



NOAA Laboratories 
Involved in HPCC 

- Geophysical Fluid Dynamics 

iMboratory (GFDL) 
Princeton, New Jersey 

- Forecast Systems iMboratory 

(FSL) 

Boulder, Colorado 

- National Meteorological Center 

(NMC) 

Camp Springs, Maryland 



By using the Internet, NOAA researchers can easily 
access massively parallel systems at distant locations. 
Geographically distributed researchers can collaborate 
and easily share NOAA computing resourcei^ and data 
by accessing these systems remotely from high perfor- 
mance workstations, 

NOAA plans to make its vast environmental data 
archives more accessible to the scientific community, 
while preserving the integrity of operational NOAA sys- 
tems. Greater NOAA Internet connectivity will substan- 
tially improve access to these data. To support this 
increased Internet use, a NOAA Internet Network 
Information Center has been established. The Center 
will provide information and assistance to all NOAA 
Internet users and to scientists at other agencies and in 
academia with whom they collaborate. 



ASTA: Environmental Grand Challenges 

NOAA is developing advanced algorithms and redesign- 
ing climate prediction and weather forecasting models to 
use new parallel programming paradigms, 

NOAA will conduct a phased acquisition of scalable par- 
allel systems for use in climate prediction and weather 
forecast modeling. The new models will be installed and 
evaluated on these systems. 



IITA: Environmental Applications and Improved 
Data Accessibility 



NOAA proposes to investigate environmental monitor- 
ing, prediction, and assessment applications, and to 
expand efforts to make its environmental data more 
accessible. 



BRHR: Increasing the Base of Researchers and 
Users 

The number of NOAA users who can effectively use 
scalable systems will grow considerably. In addition, 
substantially more visiting scientists will work with NOAA 
researchers on Grand Challenge problems, encouraging 
both evolutionary improvements and creative break- 
throughs in climate prediction and weather forecasting. 
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FY 1993 Activities and Accomplisfiments and 
FY 1994 Plans 



NOAA National Data 
Centers 

- Xafional Climatic Data Center 

Asheville, Sorth Carolina 

' Sational Oceanograp 'lic Data 
Center 

Washington, D.C. 

- Sational Geophysical Data 

Center 

Boulder, Colorado 



Network Access 

NOAA's pilot Internet Network Information Center has 
begun to provide assistance in using the Internet, net- 
work management for connected NOAA facilities, mail 
and other server capabilities, and protected access to 
selected NOAA operational data sets, such as NMC 
model output data. 

In FY 1994, at least 10 more NOAA computational and 
data archiving facilities will be connected to the Internet, 
and connection bandwidth will be increased. 



Global Atmosphere and Global Ocean Modeling 

Over the past two years, NOAA's Geophysical Fluid 
Dynamics Laboratory (GFDL) has begun redesigning its 
most important atmospheric and oceanic models to 
make them modular and parallel in design. This activity 
includes a collaborative effort by GFDL with DOE/Los 
Alamos National Laboratory (LANL) scientists that has 
led to the successful design of a model shell version of 
the GFDL Modular Ocean Model (MOM) to a form that is 
amenable to highly parallel computers and that main- 
tains its modular coding structure. High resolution 
experiments using this new code were performed on the 
1 ,024-node Thinking Machines CM-5 at LANL. 

GFDL's complete SKYHI global atmospheric grid-point 
model, which is used to study climate, middle atmo- 
sphere dynamics, and atmospheric ozone, has been 
redesigned for parallel execution and ported to the LANL 
CM-5, as part of the GFDL-LANL collaboration. 

The GFDL radiation physics package, which is a critical 
part of all GFDL atmospheric climate models, was 
redesigned to a modular form that is suited to highly par- 
allel computer systems. 

In FY 1994, high resolution atmospheric modeling exper- 
iments using a simplified-physics version of a parallel 
atmospheric grid model will be performed to test model 
sensitivity to grid resolution. 
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In FY 1994, a parallel version of the GFDL limited-area 
non-hydrostatic model will be developed for use in 
investigating the interaction between radiation and 



clouds. 




A computer model representatioh. f a 
blizzard over the Colorado Front Range 
area, produced jointly by NOAA's 
Forecast Systems Laboratory (FSL) and 
the Colorado State University. The 
image represents a six hour forecast, 
looking over Colorado from the south- 
east. The white/g^sy area depicts the 
forecast region for significant clouds, 
and the red area within the clouds rep- 
resents the region in which aircraft icing 
is likely to occur. 



Weather Forecast Modeling 

An adiabatic shell for the NOAA National Meteorological 
Center (NMC) spectral model has been developed and 
executed on a Thinking Machines CM-200 at 
DOD/Naval Research Laboratories (NRL) in collabora- 
tion with NRL. 

A regional atmospheric model has been restructured for 
execution on highly parallel systems by NMC, in collabo- 
ration with NOAA's Forecast Systems Laboratory (FSL). 

The initial restructuring and receding of the 
regional/mesoscale Optimum Interpolation (01) analysis 
code for execution on the CM-200 at DOD/NRL has 
been completed. 

FSL has developed a parallel version of the Mesoscale 
Analysis and Prediction System (MAPS) as a functional 
prototype system for both the Federal Aviation 
Administration and the National Weather Service. 

MAPS is the first of several strategic weather models to 
be parallelized for the Aviation Weather Program. 
These models will provide high resolution forecasts on 
both the national and regional levels to support opera- 
tional and aviation meteorology. The MAPS model was 
engineered using an FSL-specified layered software 
approach to provide portability among scalable parallel 
systems. 



NOAA HPCC Systems 

A scalable architecture system, a 208-node Intel 
Paragon, is being installed at NOAA/FSL in conjunction 
with the ARPA-sponsored National Consortium for High 
Performance Computing and as a part of the Boulder 
Front Range Consortium. Consortium members include 
NCAR (under NSF sponsorship), the University of 
Colorado (under ARPA sponsorship), and FSL. 

FSL has developed a benchmark suite to evaluate par- 
allel processors for use in weather analysis and predic- 
tion applications. rSL has also specified and is imple- 



ad 

ERLC 



109 




Contours representing the 'v'md flow in 
the middle atmosphere, produced by a 
weather forecast mode! running on the 
Cray y-MP8 at NOAA's National 
Meteorological Center, superimposed 
on a NOAA GOES satellite infrared 
cloud image. 



I meriting a layered software approach to support the 

i portability of such applications between various scalable 

j systems and networks of workstations, and has taken 

I the initial steps toward implementing a meteorological 

1 software library using this approach. 

i 

I GFDL has solicited technical input from massively paral- 

j lei computer vendors through a public comment process 

; as part of its effort to redesign its primary atmospheric 

I climate model to a suitable parallel design. The result- 

\ ing technical collaborations are leading to a more effec- 

; tive code design for this and other models that are being 
rewritten for parallel systems. 



Environmental Protection Agency (EPA) 

Central to EPA's mission are its Grand Challenges in air and water pollution management 
and in ecological assessment. The complex nature of these Grand Challenge problems 
demands use of the ;nost comprehensive and integrated computational assessment tools 
available. By the mid-1990s, the achievement of EPA's HPCC Program goals will provide 
more reliable and useful tools to develop improved national pollution control and prevention 
strategies involving billions of dollars in control costs. 



EPA has three main goals for its HPCC Program activi- 
ties: 

-i Advance the capability of environmental assess- 
ment tools by adapting them to a distributed het- 
erogeneous computing environment that includes 
scalable massively parallel architectures. 

-J Provide more effective solutions to complex envi- 
ronr, ental problems by developing the capability to 
perform multipollutant and multimedia pollutant 
assessments. 

-J Provide a computational and decision support 
environment that is easy to use and responsive to 
environmental problem solving needs to key 
Federal, state, and industrial policy-making organi- 
zations. 



DATA COMMUNICATION? SYSTEM ' 
STATE CONNECTJVITY 



* } r PA ll» NETWORK 



EPA participates in the NREN. ASIA, IITA. and BRHR 
components of the HPCC Program as follows. 

NREN: Increasing Access to a Heterogeneous 
Computing Environment 

EPA will expand Internet connectivity to a critical mass 
of environmental problem-solving groups at the Federal, 
state, and industrial levels and to environmental Grand 
Challenge research teams, enabling distributed comput- 
ing approaches for linking complex ecological models or 
multimedia environmental models. EPA is establishing a 
research network to support geographically distributed 
collaborative development of prototype environmental 
assessment frameworks using a distributed, heteroge- 
neous computing environment that includes massively 
parallel components and distributed data access. EPA 
will also provide environmental applications software for 
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Researchers evaluate molecular proper- 
ties of carcinogens from pollution 
sources. The image shows electric field 
vectors for benzopyrene. 
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use in performance and reliability testing of internet 
technology. 



ASIA: Environmental Assessment Grand 
Challenges 

EPA is integrating advanced environmental assessment 
tools into distributed, heterogeneous computing environ- 
ments. A major focus is on the development of parallel 
algorithms for atmospheric chemistry, transport, and 
molecular models to enable more effective study of mul- 
tipoHutant air quality issues, the impact of man-made 
chemicals on the environment, and the relationship 
between air and water pollution. In the latter case, the 
linkage of distinct air and water models will enhance the 
knowledge of complex interactions of pollutants crossing 
media boundaries, enable integrated assessment of pol- 
lutant impacts, and form the foundation for further inte- 
gration with ecological process models. Such work will 
ensure that the interaction of multiple pollutants in sev- 
eral media (such as air and water) are considered when 
assessing pollutant abatement strategies. These 
assessments are not feasible without HPCC technology. 

Environmental scientists and regulatory analysts lack 
adequate assessment tools because computational 
complexities and slow response time inhibit effective 
and extensive use of the most advanced environmental 
assessment tools. Development of a user friendly frame- 
work that puts the power of HPCC technology and 
advanced multipollutant environmental models directly 
in the hands of Federal, state, and industry groups 
charged with solving environmental pollution problems is 
a primary EPA goal. 



IITA: Enhancing User Access to Environmental 
Data and Systems 

EPA, in concert with NASA and NOAA efforts to dissem- 
inate environmental information, proposes to expand 
public access to a variety of environmental databases., 
such as ecological measurements, air and water quality 
model predictions, and population exposure to pollu- 
tants. Development of intelligent user interfaces for 
interactive browsing, retrieval, analysis, and on-line mul- 
timedia tutorials for inexperienced users will facilitate 
routine use of environmental models for regulatory anal- 
ysis and environmental education. In addition to these 
access and training systems, EPA proposes to support 



curriculum development for environmental education for 
grades 9-12 as well as university undergraduate and 
graduate programs. 

BRHR: Broadening the User Community 

EPA will develop and evaluate methods and materials 
for training Federal, state, and industrial users of 
advanced environmental assessment tools. 

It has initiated a program to train analysts who support 
environmental decision making in advanced computing 
technology. The scope of this program ranges from 
making it as easy as possible to use the models to 
developing interactive software for on-line training. 

EPA also sponsors fellowships, graduate student pro- 
grams, and high school computational science programs 
to develop interdisciplinary skills required for air ana 
water quality modeling. 



Major FY 1993 Activities and Accomplishments 
and FY 1994 Plans 



Multipoilutant Air Quality Management 




Regionat . :/ • ^ ^position Mcdef predic- 
tions of nitric acid over the eastern U.S. 



Working with the North Carolina Supercomputing Center 
and several universities, EPA has initiated a Grand 
Challenge air quality management project in which a 
user friendly, multipoilutant, multiscale air quality model- 
ing system is being developed for modeling research, 
evaluation, and regulatory assessment. 

The first prototype of the system will address regional 
and urban-scale ozone and regional acid deposition 
issues using generic scalable algorithms for key physical 
and chemical processes, and advanced technology for 
data management, interprocess communications, analy- 
ses, and visualization. 

EPA has also begun to evaluate the performance of both 
low and high end massively parallel computers on atmo- 
spheric chemistry and transport algorithms and molecu- 
lar modeling codes critical in environmental assessment. 
The Regional Oxidant Model has been ported to a 1,000 
processor MasPar for benchmarking. Molecular 
mechanics and dynamics algorithms are also being eval- 
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uated on a 32-node Kendall Square Research KSR-1 
and an Intel iPSC/860 at the National Institutes of 
Health. A variety of partial differential equation solvers 
are also being implemented for performance evaluation 
on both the MasPar and KSR machines. 

To foster communication among scientists currently per- 
forming molecular modeling research on highly parallel 
machines, EPA and the Office of Naval Research jointly 
sponsored the "Molecular Modeling on Parallel 
Computers" workshop session at the 1993 Sanibel 
Symposium. 




Three-dimensional rendition of salinity 
in Chesapeake Bay. 



Multimedia Modeling 

A multimedia project has been initiated by porting three 
single-medium (or single-disciplinary) models to super- 
computers - specifically a comprehensive regional air 
quality model, a watershed-water quality model, and a 
three-dimensional, bay hydrologic-water quality model. 
These models are used to address the nitrogen eutroph- 
ication of Chesapeake Bay - an environmental problem 
involving two major pollutant pathways of major concern 
to the Nation. 

The three models have been ported to a Cray Y-MP, 
and the air quality model has been optimized there. 
Current research focuses on linking these models 
together when there is only minor interaction among the 
different media, thereby maintaining the full disciplinary 
complexity of known and tested individual models while 
demonstrating the added benefit of multimedia modeling 
for environmental decision making. 



Visualization 

As computer capability increases, interaction among the 
different media and synergisms involving scores of pol- 
lutants are being introduced into environmental models. 
As a result, these models are becoming increasingly 
complex. Visualization groups supported by EPA's 
HPCC Program have developed high-quality videos of a 
regional acidic deposition model and an air quality 
model, demonstrating the power that visualization has to 
open up the workings of these models to both scientists 
and non-scientists. 

This effort was recently expanded as visualization 
experts began working with water quality scientists to 
display the output of increasingly complex sediment 
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. transport water quality models. As part of these efforts, a 
i new volume-rendering algorithm has greatly enhanced the 
: realism of the three-dimensional model data, and more 
visualization algorithms are under development. 



Networking 

EPA 'established a 100 Mb/s (FDDl) research network and 
has provided T1 connectivity to the Environmental 
Research Center in Georgia and to the Chesapeake Bay 
Office in Maryland. This connectivity provides the band- 
width needed to satisfy EPA's heterogeneous computing, 
data management, and collaborative visualization require- 
ments. In FY 1994 EPA will establish a T3 Internet inter- 
connect to EPA's National Environmental Supercomputer 
Center. 



Technology Transfer 

EPA is funding the establishment of a prototype training 
center and an on-site training program for Federal, state, 
and industrial personnel, initially to support air quality reg- 
ulatory decision-making policies. Hands-on training with 
state-of-the-art environmental assessment techniques will 
foster competency in high performance computing; users 
will observe the increasing speed, accuracy, scope, and 
improved management of environmental assessments 
available through high performance computing. 

EPA is evaluating the usefulness of multimedia electronic 
tutor and help approaches, and collaborative computing 
and visualization to provide expert advice to remote loca- 




i tions. A prototype interactive analysis and visualization 
[ system for a workstation environment has been developed 
i to support regulatory decision making at the state level. It 
uses the Urban Airshed photochemical model and the 
Applications Visualization System (AVS) software. The 
i pilot user group, the North Carolina Department of 
' Environment, Health, and Natural Resources, accesses 
: the North Carolina Supercomputing Center at Research 
■ Triangle Park via a newly established T1 link, in FY 1994 



Ozone concentrations seen through an ^y^^ pjjQ^ program will be extended to additional Federal, 

Mvo nnvnct^v. s\Q\e, and industrial environmental organizations. 



Computational Education 

EPA's HPCC Program helps support EarthVision, EPA's 
computational science educational program for high 
school students and teachers. Students prepare propos- 
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als during Saturday tutorials at EPA's National 
Environmental Supercomputing Center in Bay City, 
Michigan. Teams are selected to participate in a three- 
week summer educational program and to conduct envi- 
ronmental research using scientific workstations and 
EPA's supercomputer during the academic year. 



EPA Milestones 



NREN-FY1994 

J Complete T3 Internet interconnect to EPA HPCC 
Center. 

J Increase bandwidth and number of state connec- 
tions to the Internet. 



ASIA -FY 1993 -1994 

J Establish Grand Challenge collaborations. 

J Demonstrate key environmental chemistry algo- 
rithms on scalable massively parallel testbeds. 




Getting user feedback on a prototype 
user interface as part of ERA'S technolo- 
gy transfer pilot projects. 



ASTA- Beginning in FY 1994 

J Demonstrate linked air and water models in a dis- 
tributed computing environment, 

-"Install 10 gigaops testbed for Grand Challenge 
teams. 



BRHR- FY 1992 -1994 

J Establish a key set of collaborations for technolo- 
gy transfer of advanced HPCC environmental 
assessment capabilities to Federal, state, and 
industrial users. 



BRHR - Beginning in FY 1993 

J Establish fellowships and graduate level support 
for Grand Challenge teams. 
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Department of Education (ED) 

The Department joined the HPCC Program in FY 1992. Through program initiatives and 
through activities sponsored by the regional laboratories and the research and development 
centers, educators and students will have enhanced access to information and communica- 
tions resources that will lead to improved teaching and learning. 




Fairfax County Public School teacher 
ar)d students use PATHWAYS 
database and STAR SCHOOLS dis- 
tance learning materials. 



ED has supporting activities in the NREN component of 
the Program. 

NREN 

The Department's on-going activities include: 

-J Development of PATHWAYS, a computer-based 
information system designed to use the Internet to 
provide easy access by teachers, administrators, 
parents, students, and community members to 
educational information. 

-J Expansion of research and development initiatives 
in networked applications for curricula, instruction, 
and administration. 

~i Support for educational technology activities 
through: 

-Grants for equitable access to information 
resources 

-Star Schools distance learning grants for student 
Instruction and teacher staff development 




ED win work with other agencies to define and coordi- 
nate educational restructuring initiatives to take advan- 
tage of HPCC resources. 
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The speed of currents at the ocean surface simulated with a three-dimensional global ocean model devel- 
oped for the Thinking Machines CM'2 and CMS at Los Alamos National Laboratory. High speeds are in 
red, low in blue. Eddies are evident in the Gulf Stream along the east coast of North America and in the 
tropics. The spatial resolution of the computer model is 0.5 degrees in latitude and longitude with 20 verti- 
cal levels; realistic ocean bottom topography is used. The work was jointly sponsored by the HPCC and the 
DOE CHAMMP (Computer Hardware, Advanced Mathematics, and Model Physics) Program. 



n2 



Introduction to Case Studies 



This section presents examples of on-going 
Grand Challenge applications research and 
emerging HPCC hardware and software tech- 
nologies being developed in support of real- 
world problems and the HPCC Program. 

Only within the past several decades have 
advances in high performance computing and 
networking technologies merged with long 
standing theoietical and experimental methods to 
yield a powerful new computational approach to 
scientific inquiry. Thi approach has enabled 
scientists and enginocis to transcend many of the 
limitations inherent in the more traditional prac- 
tices. The demonstrated success of computation- 
al science in a wide variety of problem areas has 
led to an infusion of high performance comput- 
ing technologies and techniques into mainstream 
scientific practice. An increasing number of 
researchers, representing almost every disci- 
pline, continues to probe new and complex prob- 
lem areas - many of pressing societal concern. 

The computational approach adds another 
dimension to research methods by allowing the 
researcher to create a mathematical model of 
some aspect of reality. Solving the model entails 
translating its equations into a form capable of 
being programmed and executed on a high per- 
formance computing system. Algorithms that 
structure input data and specify the manner in 
which the calculations are to be performed are 
the primar\' building blocks of the computational 
model. By exercising the model over broad 
data ranges and parameter spaces, a picture- 
albeit a simulated one - of the real phenomena 
emerges. To the extent that it is complete and 
accurate, this picture is useful in describing real- 
ity as it exists and perhaps more importantly, 
predicting change. In man\ cases such as those 
described in this section, scientists are able to 
reach and extend the understanding (^f phenome- 
na far beyond wriat is possible through pure rea- 
soning and obser\ati(Mi. 



The success of this approach directly depends 
upon computing and data management capabili- 
ty. Input data ranges and paranieter spaces may 
be mathematical continua - infinite in dimen- 
sion. It may require billions of calculations to 
produce a single solution point, and some phe- 
nomena require billions of solution points to 
approach a useful level of completeness and 
accuracy. Thus the computational requirements 
of many applications are potentially boundless. 
Similarly, the "answers" associated with a simu- 
lation may comprise terabytes of data. Scientific 
visualization, with its ability to store and inter- 
pret data, has come to play an indispensable role 
in the overall success of computational research. 

The strengths and limitations of the computa- 
tional approach are readily evident: a simulation 
can represent reality only to the degree that it 
both holds to the physical laws of nature and 
captures the inherent complexity and detail of 
that which it attempts to represent. However, for 
many problems this is the only approach avail- 
able. Scientific instruments for observation and 
measurement confront limits ~ either thc^se 
imposed by the nature or location of the object 
of interest, or by the economics of producing the 
instrument or conducting the experiment. There 
are few alternatives to the computational 
approach for studying aspects of nature lying at 
the extremes of measurability - those that are 
very small, \ery large, very fast. \ ery slow, very 
close, very far, and so on. Yet the uniNcrse is 
filled w hh such phenomena that affect our daily 
lives. 

The examples presented here are only a small 
subset of the early achievements to come out o\' 
the High Performance Computing and 
Communications Prv>gram - a hint of the 
promise of HPCC methods and technologies 
applied to long standing problems of science and 
engineering - and humanity. 
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Case Study 1 

Climate Modeling 

i . 



SEA SURFACE TEMPERATUte 

■ tiCLACGCM-' 




CO 



Sea surface temperature from a multhyear simulation with the UCLA coupled atmosphere-ocean model. 
The atmospheric component of the model is the UCLA General Circulation Model and the oceanic compo- 
nent is the GFDL Modular Ocean Model, The simulation was performed on the Cray Y-MP at the San 
Diego Supercomputer Center. 



Understanding the Earth's climate system and its 
trends is one of the most challenging problems 
facing the scientific community today. Better 
understanding of our climate system is critical 
for the Nation as it prepares for the 21st century. 
The Earth's atmosphere-ocean system and the 
physical laws that control its behavior are com- 
plex and contain subtle details. This system is 
only crudely represented by the most compre- 
hensive of present-day climate models. 
Improvements in the computational modeling of 
many of the ci -mponent physical processes, such 
as cloud-radiation interaction, will require long- 
term effort. Climate model improvements will 
necessitate a hundred to thousand-fold increase 
in computing, communications, and data man- 



agement capabilities before these goals can be 
met. In addition, large increases in model detail 
and sophistication are necessary for regional cli- 
mate change forecasting. 

Under the sponsorship of the Federal HPCC 
Initiative and other programs, new computing 
and communications resources are being devel- 
oped for climate research. Cuirenl state-of-the- 
art climate models are being redesigned to exe- 
cute efficiently on promising new scalable archi- 
tecture systems. Scientists are also in\ est i gating 
distributed computing strategies that will use 
gigabit-per-second data transfer between distant 
supercomputers. 
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The coupled atmosphere-ocean model is the pri- 
mary tool b\ which climate scientists simulate 
the behavior of the Earth's climate s\ stem. As a 
first step in porting a fully coupled model to 
massively parallel processor systems, scientists 
at several sites are redesigning separate atmo- 
sphere and ocean model elements for execution 
on scalable parallel systems. 

A parallel ocean model, referred to as the 
Parallel Ocean Program (POP), has demonstrat- 
ed gigatlop performance during early data-paral- 
lel experiments on the 1.024-node Thinking 
Machines CM-5 at DOE's High Performance 
Computing Research Center of Los .Alamos 
National Laboratoiy (LAND. This research 
effort is being funded under DOE's Computer 
Hardware Advanced Mathematics and Model 
Physics (CHAMMP) program. LANL scientists 
collaborate on the project with scientists at 
NOAA's Geophysical Fluid Dynamics 
Laboratory (GFDL). the Naval Postgraduate 
School (NPS). and NSF's National Center for 
Atmospheric Research (NCAR). 

Over the past decade, the U.S. academic com- 
munity has made extensive use of NCAR's 
Community Climate Model (CCM) for global 
climate research. Recently, researchers at two 
DOE laboratories. Argonne National Laborutorv 
and Oak Ridge National Laborator\. also funded 
under the CHAMMP program, have been collab- 
orating with NCAR scientists to develop parallel 
versions of the latest CCM code to run on next 
generation massively parallel systems. This 
model, referred to as the Parallel Communit\ 
Climate Model 2 (PCCM2). is now demonstrat- 
ing near gigatlop performance on the 1 2 -pro- 
cessor Intel Touchstone Delta. A data parallel 
version for the Thinking Machines CM-5 is also 
being prepared. In ongoing investigations, 
researchers arc exploring new parallel algo- 
rithms designed to improve performance on 
message passing systems and incorporating new 
numerical methods that will improve climate 
simulations. 

Scientists at the Lawrence Livermore National 
Laboratorv (LLNI.) are simultaneouslv develop- 
ing a message passing version ot the models 
described above. These versions treat the inher- 



ent parallelism of climate problems in a different 
fashion and can be executed on the class o( par- 
allel systems built around the distributed memo- 
ry architectural approach. 

A high-resolution atmospheric general circula- 
tion model, known as SKYHL has been devel- 
oped and used by scientists at NOAA's GFDL to 
investigate stratospheric circulation and o/.one 
depletion for a number of years. The o/one 
depletion study was presented in ''Grand 
Challenges 1993'' and is an example of some of 
the scientific results obtained from this model. 
GFDL scientists are now working with LANL 
scientists to reconstruct the programs thai make 
up the SKYHI model in order to execute it on 
massiveK parallel systems that support data par- 
allel and message passing programming 
paradigms. 

These various model development efforts all 
have the same ultimate objective - to develop a 
coupled atmospheric-ocean climate model that 
will execute efficientU on scalable parallel com- 
puters. 

.lust as demand for more computational 
resources is growing within the climate research 
community, so also is the need to distribute the 
computing load among different computers, both 
at one site and across the country when appropri- 
ate. With this objective in mind, researchers at 
the University of California. Los Angeles 
(UCLA) are collaborating with scientists at 
NSF's San Diego Supercomputer Center 
(SDSC). the California Institute of Technologv 
(Caltech). and NASA's Jet Propulsion 
Laboratory (JPL) to demonstrate the feasibilitv 
of distributed supercomputing of a coupled cli- 
mate model. In this research, separate compo- 
nents of the atmosphere and ocean codes in a 
single climate computation are distributed over 
multiple supercomputers connected via a high 
speed network. Initial prototype experiments 
have been performed between Cray Research Y- 
MP systems at SDSC and NCAR. connected by 
a 1.5- megabit-per-second T-l data link. The 
imminent availability of a gigabit-per-socond 
network under the C^ASA gigabit testhed project 
will soon allow for a much move advanced coui- 
munications capabilitv. Plans then call for com- 
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putations to be distributed between a Cray Y-MP 
at either SDSC ov JPL and an Intel supercomput- 
er at either SDSC or Caltech. Such distributed 
computing experiments provide realistic tests for 
the gigabil-per-second connections that are 
anticipated on the NREN of the future. 



SPONSORING AGENCIES AND PROGRAMS 
ARPA 
DOE 
NASA 
NOAA 
NSF 



PERFORMING ORGANIZATIONS 
ArgDiinc National Laboratory 
California Instilulo of Technologx 
Geophysical Fluid Dvnamics Laborator\ 
Jet Propulsion Laborators 
Los Alamos National Laboratory 
National Center for Atmospheric Research 
Na\ al Postgraduate School 
Oak Ridge National Laboratory 
San Diego Supercompater Center 
University of California-Los Angeles Climate 
Dvnamics Center 
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Case Study 2 

Sharing Remote Instruments 




Specimens of chick cerebellum stained with osmium and reduced with potassium ferrocyanide. Image B 
shows a higher magnification of a portion of Image A, The images were obtained in a study of the internal 
membrane structure of the Purkinje cell 



HPCC-supporled advances in computer net- 
works and visualization software are allowing 
scientists to control and share remole micro- 
scopes, telescopes, and other scientific instru- 
ments in an interactive, real-time fashion. These 
types of projects have opened the doors of the 
laboratory to a new concept - the "distributed 
laboratory" - which integrates laboratory equip- 
ment, high performance computing systems and 
data visualization tools over a high speed net- 
work, resulting in a more comprehensive and 
scientifically valuable investigative environ- 
ment. 



Remote Microscopy 

Researchers at the University of California-San 
Diego Microscopy and Imaging Resource have 
implemented a sophisticated, computer-con- 
trolled high-voltage transmission electron micro- 
scope (HVEiM). Working in collaboration with 
staff scientists at the San Diego Supercomputer 
Center and the Scripps Research Institute, the 
research group has coupled the HVEM via a 



high speed network to high performance com- 
puting systems and interactive visualization soft- 
ware running on scientists' workstations. The 
microscope is a unique resource, one of only a 
few such microscopes in the United States in use 
in biological science. More powerful than ordi- 
nary electron microscopes, it can accommodate 
much thicker laboratory specimens, yielding 
greater amounts of bioiogical information. 
Using computer tomography and other visualiza- 
tion techniques, the images collected can be used 
to produce three-dimensional animations, allow- 
ing scientists to look at many previously uninter- 
preted areas of biomedical science relating bio- 
logical function with structure. 

The subjects of such study include the disruption 
of nerve cell components resulting from 
Alzheimer's disease, the structural relations of 
protein molecules involved in the release of cal- 
cium inside neurons, and the three-dimensional 
form of the Golgi apparatus, where sugars are 
added to proteins. 

This project is an example of the application of 
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Scientists no longer need to be in the same room 
with their laboratory equipment. Instead, they 
can control it over the network from their desktop 
computers. Pictured is a scientist controlling a 
high-voltage electron microscope (useful for 
imaging thick three-dimensional biological 
tissues) from her Sun workstation. 



diverse technologies to a single class of scientif- 
ic problems. The capabilities of the microscope 
for scientific investigation will soon be extend- 
ed, combining image data acquisition with com- 
puting resources to render, view, and animate the 
images for real-time analysis. By connecting the 
microscope to a high speed network, the instru- 
ment will someday be made available to investi- 
gators located in any geographic region, extend- 
ing the accessibility of the resource to a broader 
scientific community in a collaborative environ- 
ment. 

Future plans call for extending this environment 
to the Apple Macintosh: implementing automatic 
focusing and calibration of the microscope (now 
handled by a human operator); developing 
remote image analysis tools: optimizing the 
tomography reconstruction code currently run- 
ning on a Cray Y-MP system: and implementing 
the code on a parallel computing platform. 



Real-time Radio Telescope Observatory 

The application of the operational concepts 
described abo\'e is not limited to microscopes, 
A research group affiliated with the National 
Center for Supercomputing Applications 
(NCSA) in Champaign-Urbana, IL is investigat- 
ing how to apply this model to real-time radio 
telescope obscr\'ation. This group is seeking to 
demonstrate the feasibility of connecting the 
Berkeley-Illinois-Maryland Array (BIMA) radio 
telescope array, located at the Hat Creek 
Observatory in northern California, to NCSA 
supercomputers via high speed networks. 

One of their needs calls for transferring a giga- 
byte-size observed visibility dataset from the 
telescope to NCSA for processing, and then 
returning the processed data to Berkeley for 
analysis on a workstation. In this way, the 
astronomer can judge the quality of the data, see 
if the signal is strong enough to proceed with the 
observations, judge whether the area of the sky 
being mapped is correct, and experiment with 
processing parameters. By connecting BIMA 
directly to BLANCA, one of five HPCC sup- 
ported gigabit testbeds, and increasing the num- 
ber of present antennae from three lo six, the 
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group expects to achieve a data transfer rate 10 
lo 100 times higher than current rates. This 
could allow real-time steering of the telescope, 
thereby greatly enhancing the value of an obser- 
vational session and rexolutionizing the in 
which astronomy research is performed. 



REMOTE MICROSCOPY 

SPONSORING AGENCIES AND 
ORGANIZATIONS 
Dal ac II be. Inc. 

Ncivxork S\ stems Corporation 

NIH 

NSF 

Photometries LTD 

State of and l'ni\ersit\ of Ciilifomia 

Sun NticrosN stems Computer Ccirponaion 



PERFORMING ORGANIZATIONS 
San Diego Supercomputer Center 
The Scripps Research Institute 
Tniversity of California- San Diego 

- San Diego Microscopy and Imaging Resource 

- Computer Science and Engineering 

Department 

REAL-TIME RADIO TELESCOPE 
OBSERVATORY 

SPONSORING AGENCIES AND 
ORGANIZATIONS 
NSF 

State of and I'niversits of California 
State of and Cniversits of Illinois 
State of and l'ni\ ersit\ of Mar\ land 

PERFORMING ORGANIZATIONS 

National Center ior Supercomputing Applications 
University of California-Bcrkeles 
l'ni\ersit\ of Illinois-Champaign-rrbana 
l'ni\ersit\ of Mar\ land 
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Case Study 3 

Design and Simulation of Aerospace 
Vehicles 




Airflow is simulated over and past the wing of a high performance aircraft that is using vectored thrust while 
descending to a few feet above the ground (in ground effect). 



Improved design and simulalion of advanced 
aerospace vehicles is a primary goal of ihe 
NASA HPCC Program. Massively parallel pro- 
cessing and related high performance computing 
technologies are enabling new simulation and 
optimization methodologies for flight vehicle 
design. These methodologies combine nuiliiple 
physical disciplines and integrate vehicle com- 
ponents such as the airframe, propulsion sys- 
tems, and controls. Improved aircraft design 
resulting from high performance computing 



promises to give the U.S. aerospace industry a 
critical competitive edge. Early and continuous 
coordination between NASA research centers, 
other Federal agencies, academia and industry is 
crucial to the success of this endeavor. 

Scientists at NASA's Ames Research Center 
have developed computer simulations of air flow 
past a delta wing at takeoff and landing that will 
help design more efficient and cost-effective air- 
craft. By porting a single discipline computa- 
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tional fluid dynamics code to a number of scal- 
able parallel computers, the scientists simulated 
applications involving moderately complex 
geometries. For example, a simple powered lift 
vehicle that includes a wing and two lifting jet- 
son is shown on the previous page. Navier 
Stokes computations were performed to simulate 
flow past a delta wing with thrust revcrser jets in 
a ground effect environment (takeoff and land- 
ing). These preliminary simulations will provide 
insight into the computational interaction of 
thrust elements, and upwash and reingestion of 
hot air and gases, leading to significant improve- 
ments in aerodynamic performance. 



Improved design processes for advanced aircraft 
and spacecraft through the use of advanced com- 
putational fiuid dynamics and structural analyses 
is also the subject of research by scientists at 
Langley Research Center. Scientists are focus- 
ing on the design and modeling of a High Speed 
Civil Transport (HSCT). One of the greatest 
challenges in modeling the Huid dynamics of 
these vehicles is developing mathematical equa- 
tions that accurately simulate turbulent airfiow. 
Turbulent flow simulations currently used lose 
accuracy at high speeds. Development of an 
optimal airframe design for a HSCT involves 
thousands of design iterations, each requiring a 




Airspeed contours around a three-dimensional aircraft traveling at Mach 0. 77 are revealed by using an 
advanced simulation method (lower figure). Blue areas represent slower moving air, yellow and red the 
fastest moving air. Flow calculations for this complex geometry were based on the unstructured mesh 
shown in the upper figure. 
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Airflow through several components of a jet engine is simulated on a cluster of IBM RISC 6000 
workstations. 



large amount of computing time to recalculate 
how changes in one part of the design affect the 
rest of the structure. Langley scientists have 
developed a m-^'.hod to streamline this part of the 
overall process and reduce the amount of com- 
puting time neeacd for each iteration. 

Researchers at NASA Lewis Research Center 
are developing a prototype Numerical 
Propulsion System Simulator (NPSS) that will 
allow dynamic numerical and visua! simulation 
of engine components. The prototype is intend- 



ed to simplify the process of dynamically con- 
necting engine component software across vari- 
ous machine architectures. This will allow 
industry to design, engineer, and fabricate 
tomorrow's propulsion systems. This multidisci- 
pi i nary research, coupled with the improved per- 
formance offered by massively parallel comput- 
ers, will greatly enhance the ability of aircraft 
manufacturers to analyze different design 
options rapidly and then efficiently produce 
vehicle propulsion systems w 'wh optimal perfor- 
mance and reduced desijin cycle costs. 
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Case Study 4 

High Performance Life Science: 
From Molecules to MRI 




Computer modeling of the Purkinje neuron helps explain its branching network of nearly 200,000 
connections to other brain cells. 



High performance computing and communica- 
tions is providing valuable insights into the mys- 
teries of human health and disease. These 
sophisticated new techniques allow for unprece- 
dented study and understanding of the remark- 
able self-assembly of atoms into molecules, 
molecules into cells, cells into tissues, and organ 
systems into the complete organisms thai consli- 
tute humanity itself. Important new medical 
knowledge and new diagnostic tools have result- 
ed from the HPCC Program. 



At the molecular level, supcrcomputing and sci- 
entific visualization have provided valuable 
insights into the molecular basis of asthma. 
Corporate scientists at Eli Lilly collaborated 
with visualization specialists at the National 
Center for Supercomputer Applications to model 
the three-dimensional molecular motions of 
leukotrienes, naturally occurring "messenger 
molecules" that induce the lungs to become stiff 
and inllamcd. With the goal of designing new 
medicines to block the leukotricnc receptor in 
the lungs, these researchers used supercomputers 
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to calculate the position of each atom in several 
related leukotrienc molecules; three-dimensional 
scientific visualization then displayed the subtle 
differences in atom positioning that are crucial to 
biological activity. More effective medications 
with fewer side effects arc the goal of this high 
performance molecular dynamics computing. 

Molecules assemble themselves into cells and 
tissues* and at this level also computerized anal- 
ysis has expanded our knowledge. One of the 
most complicated cells in the brain is a neuron 
called the Purkinje cell: each one of these cells 
may have up to 200,000 electrical connections 
with other brain cells. Researchers at the 
California Institute of Technology used an 
experimental massively parallel computer to 
model the response of Purkinje cells to chemical 
and electrical stimuli. Their model emulates the 



observed behavior of the living cell, and pro- 
vides evidence that although the connections to 
other neurons are voluminous, there is an elegant 
simplicity in the spatial arrangement of these 
brain interconnections. 

Cells and tissues organize into body systems, 
which can also be better understood using HPCC 
technologies, Magnetic Resonance Imaging 
(MRl) is a widely used method for imaging 
internal structure of the human body that pro- 
duces two-dimensional cross section views. 
Researchers at Sandia National Laboratories, in 
collaboration with Baylor University Medical 
Center in Dallas and the Department of Veterans 
Affairs Medical Center in Albuquerque, have 
used massively parallel supercomputers to turn 
two-dimensional MRl images into three-dimen- 
sional views, and revealed previously hidden 




Massively parallel supercomputing turns two-dimensional magnetic resonance images into three- 
dimensional maps that can identify early breast cancers. 
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The molecular dynamics of three different 
leukotriene (LTC4, LTD4, and LTE4) molecules 
portrayed with a new supercomputing 
visualization technique called "ghosting." Dense 
shadows represent the configurations in which 
the molecules spend a greater amount of time, 
while the range of molecular movement is shown 
by the extent of the dot patterns. 



information. Communicating their data via the 
Internet, these groups compared three-dimen- 
sional MRl to standard X-ray mammography for 
the detection of early breast cancer, and found 
that the new technique revealed early tumors that 
could not be detected by mammography. 
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Case Study 5 

Energy Resource Recovery 





A numerically intense geological database that describes the physical and chemical conditions of the Gulf 
Coast Sasin is assisting the scientists of the Global Basins Research Network to understand the processes 
that control the movement of oil and gas in sedimentary basins. By visualizing the data scientists are able 
to observe sedimentary conditions that would othenA/ise take much longer to investigate. This image 
depicts the various structures beneath the ocean flow in an area off the shore of Louisiana. Two faults are 
shown, in addition to three geographic layers: (from bottom) top-of-salt, shale, and sand and shale. 



Hiizh perform an cc computing plays an important 
role in the rLX\)very of non- renewable energy 
resources. About two -thirds of the U.S. energy- 
supply comes from oil and gas, and although 
much oil continues to be imported, there are pro- 
found advantages to domestic production: for 
example, ensuring a stable supply and price to 
the consumer. While most large U.S. oil reser- 
voirs have already been discovered, two-thirds 
of the oil still remains in old fields after conven- 
tional recovery technology has been applied, 
Hnhaiiced oil recovery (EOR) using advanced 
technologies has the potential to recover another 
100 billion barrels worth about two trillion dol- 
lars at today's prices. 

Domestic oil and gas producers are working with 
scientists from other sectors to optimize recov- 
ery methods for existing petroleum reservoirs. 
Petroleum industry scientists use reservoir simu- 
lations run on high performance computers to 
delermiiie the production potential of reser\oirs 
and the most efficient methods to extract 
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petroleum resources before in\estment in field 
operations is made, The simulations model large 
complex field problems quickly, accurately, and 
efficiently, leading ultimately to reduced recov- 
ery costs. Research projects combining the 
expertise of researchers from universities, indus- 
try < and government focus on ways to improve 
reservoir simulation methods for How through 
porous media, pore-scale multiphase How, and 
hydrocarbon migration. As a technological spin- 
off, EOR simulation can be applied to remedia- 
tion strategies for underground, contaminated 
sites. 



Parallel Algorithm.s for Modelinj? Flow in 
Porous Media 

New parallel algorithms for computational mod- 
els describing the How of oil and other organic 
chemicals in porous media are an important 
technical development. Models employ stochas- 
tic and conditional simulation and lake into 
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account numerous variables associated with 
reservoir behavior caused by complex physical 
and chemical phenomena. Parallel algorithms 
help researchers utilize the computational power 
of massively parallel computers to perform the 
simulations. Researchers are also writing paral- 
lel versions of two widely used resenoir simula- 
tion codes, UTCHEM and UTCOMP. 
UTCHEM has been applied to study both surfac- 
tant EOR and surfactant remediation of ground 
water contaminated by dense nonaqueous phase 
liquids found at weapons sites and other loca- 
tions. 



samples. To assist in interpreting experimental 
results, researchers are developing a basic theo- 
retical framework for multiphase How systems 
that incorporates current knowledge of displace- 
ment processes and the understanding of oil and 
rock chemistry. One technique in this frame- 
work, the Lattice- Boltzmann method, is essential 
for solving Navier-Stokes equations, the basic 
equations of fluid flow. These equations are the 
basis of the mathematical models that simulate 
the movement of a multiphase system of organic 
materials through rock pores. 



Pore-scale xMultiphase Flow Modeling 



Imaging of Present-day Hydrocarbon 
Migration 



To better understand and predict the interactions 
between fluids and rock. Held simulation pro- 
grams must extrapolate results from laboratory 



Scientists are developing computer visualiza- 
tions to chart fluid movements below the ocean 
floor of the Louisiana coast. Observations in 
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This figure shows a comparison between the computed injectivity of carbon dioxide and field data from an 
oil reservoir in Texas operated by Texaco, Inc. The University of Texas compositional reservoir simulator 
UTCOMP was used to make this calculation. The capability to predict the rate at which carbon dioxide can 
be injected into these old wells to increase the oil production from the field is crucial for the economic 
success of such enhanced oil recovery operations. This comparison shows close agreement with the field 
data from a geologically complex San Andres formation. 
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ihis area arc providing new insights inio how 
o\ L-r-prcssurcd oil and gas move in sedinieniary 
basins. Because ihe siudy area encompasses the 
largest oil rieki in ihe coniinenial United States, 
these insights ma\ have important economic 
consequences. Researchers are developing visu- 
al modcN that reflect changes in temperature, 
pressure, and strata of sand and shale to allow 
qualitative evaluation of the rate of fluid flow 
required to produce these changes. 
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Case Study 6 

Groundwater Remediation 




Map of Oak Ridge Waste Slcxagc Facility Computational Grid for Waste Area Grouping 6 




Modeiir^ the Effect of Capping WAG 6 Waste Burial Trenches Computed Water Table Elevations after Capping 



Contamination of groundwater by potentially 
toxic organic liquids is one of the more seric^us 
environmental problems facing the Nation. The 
release of such liquids has been widespread, 
originating from sources ranging from gasoline 
service stations to large industrial facilities. 
Once trapped in the subsurface these liquids 
serve as long-term sources of aquifer contamina- 
tion. Remediation schemes include optimal liq- 
uid rccmer) pumping schemes. soK ent and sur- 
factant Hushing, and steam injection. 

Hierarchical models of groundwater flow and 
associated chemical transport arc needed at the 
local, basin, and regional scales to assess waste 
transport and rcincdiation schemes. Current 
models are limited computaiionalK in two \Ka\s: 



first, models can only include a limited number 
of physical and chemical processes before com- 
puting runtimes become prohibitive; second, 
models lack adequate field data to characterize 
geologic and chemical factors that influence 
contaminant behavior. High performance com- 
puting systems arc needed both to model com- 
plex transport processes and to overcome data 
limitations by using computationally intensive 
parametei" estimation techniques. 

The Partnership in Computational Science 
(PICS) consortia project funded by the DOH 
HPCC program is exploring neu approaches to 
modeling groundwater flow at waste sites in 
extremely cornplex hydrogeologic settings. The 
consortia consists of members trom Brookha\en 
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Nalionul Lab, Oak Ridge Nalional Lah. Rice 
I'niversiiN, SL'NY-Slony Brook. Texas A&M. 
and the University of South Carolina. A map of 
the site most extensively studied (WAG 6) is 
given in Figure A. Researchers at ORNL have 
adapted an existing Unite element code to run on 
an Intel scalable parallel distributed-memory 
system. By using a preconditioned conjugate 
gradient solver, users were able to distribute por- 
tions of the model grid to different processors 
and greatly reduce solution time. Using a 
4().0()() node grid (Figure B). they are obtaining 
anisotropy factors and boundary conditions that 
can be used to model smaller areas and test the 
effects of remediation schemes on models of the 
waste areas. One such remediation scheme is to 
cover areas with a water-impermeable mem- 
brane (cap) to eliminate surface recharge (F'igure 
C). A calculation of the water table following a 
capping is given in Figure D. Such results point 
to tiie specific piezomctric wells for which 
experimental indications of capping effects 
should be sought. 

Pacific Northwest Laboratory is also exploring 
the use of scalable massively parallel quantum 
chemistry algoiithms to improve methods for 
redesigning en/ymes to better degrade pollu- 
tants, for extracting contaminants from soils, and 
for burning halohydr(K*arbons. 

Researchers at the EPA's Robert S. Kerr 
Hnv iron mental Research Laboratory and cc^llab- 
orators at various universities have focused 
efforts on developing process understanding 
using complementary numeriLul models and lab- 
oratory studies, implementation of numerical 
miulels has t\^l lowed apprcniches originally 
developed in the petroleum industry and 



advanced multiprocessor techniques. A large 
scale physical model i* currently being used to 
evaluate the numerical model. Release of an 
organic liquid is planned for the physical model, 
followed by testing of remedial technologies. A 
remediation approach involving surfactant llood. 
followed by vapor extraction above the water 
table, is being designed by bench scale laborato- 
ry studies and adaptation of a sophisticated 
numerical model developed b\ the University of 
Texas at Austin. Other remediation models are 
also under development. Joint field and model- 
ing studies in cooperation with the USDA are 
underway to assess the impact of agricultural 
chemicals on vv ater resources in the midwest. 

Groundwater models will not eliminate the need 
for adequate Held data but will continue to assist 
scientists in understanding these complex sys- 
tems, thus contributing to reducing the risks to 
public water supplies. 
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Case Study 7 

Improving Environmental Decision 
Making 




Concentration of sediments in Lake Erie resulting from a large storm. Concentrations are color coded, with 
the highest shown Jn red. Winds from storms produce waves, which in turn create bottom currents and tur- 
bulence that can cause contaminated bottom sediments t > be resuspended in the water column. The shal- 
lower the water, the stronger the effects of the wave action. Consequently, sediment concentrations tend to 
be largest in shallow sections. 



High performance computing iv crucial to 
improve decision making on environmental 
issues. Improved numerical computer models 
provide more accurate predictions of pollution 
so that our leaders will he in a better position to 
make policy decisions in\ ()lving the en \ iron- 
menl and economic growth. The accuracy of 
:iiese models depends upon descriptions of phys- 
ical, chemical and biological processes thai ade- 



quately incorporate important causal interac- 
tions, nonlinearities, synergies, and feedbacks, as 
well as capture noninluitivc interactions. The 
linkage of single media models and the develop- 
ment of mcgamodels are essential for more reli- 
able management of the environment. 

Three areas of en\ ironmental decision support 
have been established as part of HPA's HPCC 
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Program: air pollution, walcr pollution, and the 
combined effects of air and water pollution on 
coastal estuaries that lead to de-oxygenation. 

Air Pollution 

The Clean Air Act amendments mandate State 
use of air quality models to demonstrate the 
effectiveness of proposed approaches for reduc- 
ing air pollution in highly polluted areas. 
Researchers at RPA and the North Carolina 
Supercomputing Center in Research Triangle 
Park. NC are developing a decision support sys- 
tem to satisfy a wide range of related air quality 
modeling, information and analysis needs. New 
computational capabilities enable improved air 
quality models to address muitipollutant interac- 
tions among acidifying species, oxidants and 
aerosol, and interactions with meteorology. 
These complex, three-dimensional, time-depen- 
dent models are used to evaluate alternative pol- 
lution control strategies where interactions at 
different scales, from urban to regional, are crit- 
ical and require new approaches made possible 
only through high performance computing. The 
North Carolina Department of Environment, 
Health and Natural Resources is testing an early 
prototype of an urban airshed modeling system. 

Water iPoHution 

Contaminated bottom sediments and the associ- 
ated decrease in water quality are a major prob- 
lem in hundreds of rivers, lakes, harbors, estuar- 
ies, and near-shore areas of oceans. In order to 
remediate this problem and evaluate possible 
management alternatives for the disposition of 
these toxic sediments, EPA-supported 
researchers at the University of California- Santa 
Barbara are developing computer intensive 
three-dimensional, time-dependent models of the 
hydrodynamics, particle transport, and sediment 
bed dynamics coupled with meteorology. 
Significant biochemical reactions that affect the 



fate of contaminants are also included in the 
models. Work currently focuses on the Great 
Lakes region of the United States. F^igure I 
shows that redistribution of toxic sediments in 
Lake Erie due to a large storm is highly depen- 
dent on wind direction and speed, and water 
depth. 

Linked Air and Water Pollution 

Interactions between pollutant media, such as air 
and water, often significantly affect the environ- 
ment. Air and water pollution both contribute to 
an overabundance of nutrients in coastal estuar- 
ies causing lack of oxygen and eventual decline 
of commercial productivity of the estuaries. 
Researchers at EPA's Environmental Research 
Laboratories in North Carolina and Georgia, and 
the Chesapeake Bay Program Office in 
Maryland are developing loose linkages between 
air and water quality models to study the impact 
of nitrogen deposition by air and vsater sources 
on the decline of coastal estuaries of the 
Chesapeake Bay. 

In some cases, only minor feedbacks exist 
between the different media. Loosely linking 
current single-medium models retains the known 
features and complexity of each model. This 
linkage provides additional information for moie 
effective policy determination by individual pol- 
lutant media decision making communities. 
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Case Study 8 

Galaxy Formation 






Visualization of a small portion of the computational results of an astrophysical simulation of 8.8 million 
gravitating bodies run on 512 nodes of the Concurrent Supercomputing Consortium's Intel Touchstone 
Delta System. The image shows about 137,000 gravitating bodies that form a single halo about 400 mega- 
parsecs across. Color represents projected density along the line of sight, i. e., different colors correspond 
to pixels that "contain" different numbers of bodies. Densities are much higher at the center of the object. 
The entire simulation contained about 700 halos like the one depicted here. 
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The process by which gahixics form is among - modern obscrvalic>ns span the electromagnetic 

the most important unsolved problems in spectrum IVom radio IVcqucncy to gamma rays, 

physics. There is a wealth of observational data Ho\ve\ cr, a firm theoretical understanding is yet 
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to be acquired. Qiicsiioiis as simple as. "Why 
arc there two families of gahixics, spiral and 
elliptical?" remain unanswered. 

The first step in understanding how galaxies and 
stars form is to understand the environment in 
which their formation occurs. Scientists infer 
that approximately 90 percent of the mass of the 
Universe is in the form of dark matter, that 
which can be observed only indirectly, through 
its gravitational influence on observable matter, 
such as stars, gas clouds, and nebulae. 
Simulations are used to study the shapes and 
dynamics of dark matter halos that are known to 
surround observed galaxies. 

One obstacle to the development of efficient 
codes to simulate the galaxy formation process is 
the sheer size of the problem. To obtain useful 
information, the software must simulate the 
interactions of millions of bodies. Improved 
algorithms for N-bods calculations have been 
developed and adapted to this problem. Even 
with the new algorithms, however, conventional 
supercomputers lack the computational power to 
perform simulations in a reasonable period of 
time at an acceptable level of resolution. A few- 
hundred thousand bodies is the most that con- 
ventional systems can model at a time, about two 
orders of magnitude too few to obtain new scien- 
tific results. Hence, scientists must turn to par- 
allel computers - and very large ones at thai - to 
perform the computations. 

Parallel versions of simulation code are general- 
ly more difficult to develop than those for 
sequential computing systems because of the 
inherent complexity of parallel systems, hi this 
particular case, code development was further 
complicated by the requirements for internal 
data organization in the program that needed to 
adapt as the computation progressed to reflect 
changes in the structure of the evoKing universe. 



Concurrent Supercomputing Consortium 
(CSCC) scientists overcame these programmii»g 
difficulties and recently developed a parallel 
simuiation code for the 512 node Intel 
Touchstone Delta System, which achieved 
speedups in excess of 400 over the single pro- 
cessor speed- 
In March 1992, researchers ran a simulation with 
almost 8.8 million bodies for 780 timesteps on 
5 1 2 processors of the Touchstone Delta system. 
The simulation was of a spherical region of 
space of diameter 10 megaparsecs (or. about 30 
million light years); a region large enough to 
contain several hundred typical galaxies. The 
simulation ran continuously for 16.7 hours, and 
carried out 3.24 \ 1.014 floating point opera- 
tions, for a sustained rate of 5.4 gigaflops per 
second. Algorithm improvements accounted for 
nearly a 3,000-fold improvement in execution 
time over traditional calculation methods. 
Subsequently, the research team ran two 17.15 
million body simulations using the Cold Dark 
Matter model of the Universe. These simula- 
tions, the largest N-body simulations ever run, 
took into account recently acquired microwave 
background measurements gathered by the 
COBE satellite. 
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Case Study 9 

Chaos Research and Applications 



Simple visual example of the patterns that Chaos finds in complexity. 



'Chixos' is used here as a icrm lhal refers lo a 
\ariely of new melhods for dealing wiih nonlin- 
ear inlerdepcndcnl systems. This class of com- 
plex systems, noted for sensitivity to small 
effects and seemingly erratic behavior, has been 
difficult to comprehend using traditional meth- 
ods and conceptuali/,ations. The methods of 



chaos have pro\en to be remarkably effective in 
revealing i^nv forms of simplicity hidden v/ithin 
complexity. This in turn has led to new under- 
standings of how such systems operate. 
Nonlinear systems phenomena are present in 
many fields ~ from physics, engineering and 
meteorology to medicine, psychology and cco- 
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nomics. Consequently there are many opportu- 
nities for application of the methods of chaos. 

Computing capability makes the new approaches 
possible. The methods of chaos focus on the 
geometry of behavior of a system as a wliole and 
are computationally intensive. Underlying pat- 
terns of behavior are best revealed through the 
use of graphical representation of data. It is only 
with the availability of high speed processing 
and improved technologies for graphical display 
of data that it has become possible lo explore a 
range of behavior of nonlinear systems suffi- 
ciently large to permit observation of patterns 
within complexity. The need for geometric 
approaches to such problems has been known for 
many years - it was first demonstrated by 
Poincare in 1892 in his proof that the three-bod\ 
problem could not be solved by linear or simple 
curve approximation methods. However, com- 
putational complexity of the problems prevented 
Poincare* s methods from being widely applied 
until the advent of high performance computing. 

As a field chaos is less than 30 years old, but its 
methods are now being applied to problems in 
many fields of science and engineering. For 
example, in physics chaos has been used lo 
refine the understanding of planetar\- orbits, to 
reconceptnali/x quantum level processes, and to 
forecast the intensity of solar activity. In engi- 
neering, chaos has been used in the building oi" 
better .'igital filters, the control of sensitive 
mechanisms such as ink-jet printers and lasers, 
and to model the structural dynamics in such 
structures as buckling columns. In medicine it 



has been used to study cardiac arrhythmias, the 
efficiency of lung operations. EEC patterns in 
epilepsy, and patterns of disease communication. 
In psychology it has been used to study mood " 
Huctuaiions, the operation of the olfactory lobe 
during perception, and patterns of innovation in 
organizations. In economics it is being used to 
find patterns and develop new t\ pes of econo- 
metric models for everything from the stock 
market to v ariations in cotton prices. 

As an example of the multi-applicability of 
chaos research products, a research group at the 
University of Maryland is developing control 
methods for highh sensitive chaotic processes. 
The control methods are to be used in such 
diverse applications as laser contiol. arrhythmi- 
cal cardiac tissue, buckling magnetoelastic rib- 
bon, and, in conjunction with Oak Ridge 
National Laboratory, tluidi/ed bed dev ices used 
in chemical and energy applications. 

Because chaos is new, growing and deeply inter- 
disciplinary, it benefits greatly from the emerg- 
ing NREN serv ices for access to remote systems, 
for sustaining collaborative research activities, 
and for initiating and maintaining scientific dia- 
logue. 
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Case Study 10 

Virtual Reality Technology 




The photograph shows an investigator, with a head-mounted display and a force-feedback manipulator con- 
trolling the tip of a scanning tunneling microscope (STM) probe, exploring the surface of a sample of materi- 
al. The image projected on the wall indicates the view that the investigator sees and changes as his head 
position and orientation change. The region of the surface shown is 25 Angstroms on a side. 



Virtual realily (VR) is the human experience of 
perceiving and interacting ihrough sensors and 
effectors with a synthetic (simulated) environ- 
ment containing simulated objects as if it were 



real. It is supported by advances in simulation 
technology that allow linking human capabilities 
and computational resources, sensor systems and 
robotic devices for real-time tasks. VR technol- 
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/n fA7/s closeup of the sample on the preceding 
page, atomic-level structures of carbon rings at 
the surface are seen. A button permits energy to 
be supplied on demand through the STM tip to 
modify the surface by breaking bonds, displacing 
various structures and enabling physical and 
chemical reactions. 



ogy can be applied to many tasks that would he 
more difficult to do by other methods. 

The view of the simulation that a person sees is 
an encompassing "immersion" perspective that 
appears to he from a position inside the simula- 
tion itself. By changing the view with head 
motion and orientation. VR "engages" a human's 
visual perception, vestibular system, sense of 
balance, cognition and motor reactions to such 
an extent that the immersion scenario is experi- 
enced as real . 

With VR technology, a human and a computer 
operate together as a combined system, one that 
is far more capable than either taken individually 
when performing a large variety of tasks. For 
example, the environment is particularly weil- 
suited to support reaction to unanticipated sce- 
narios, ones that can exploit the corrective judg- 
ment of a person or of skilled teams ol' experts. 

This enabhng technology can be used to improve 
producti\it\ in man\ impiMtant areas. There arc 



numerous applications in the domains of health 
care, education and lifelong learning, manufac- 
turing and other areas where this technology 
shows great promise. Early results have shown 
increased productivity and a draniatic reduction 
of resource requirements in many instances. 
Examples of current use include: 

-J Manipulation of molecules for develop- 
ment of nanotechnology devices and 
chemical sy.stems. 

-"Shared surgical interventions. 

-"Exploration of networked databases and 
digital libraries for learning and research. 

-'Modeling, simulation, and analyses. 

-"Scientific and technical visualization 
applications. 

-"Prototyping and planning. 

-"Training for and monitoring of complex 
human-computer tasks. 

In order to keep pace with real-time interaction, 
VR technology must be supported by high per- 
formance computers, associated software and 
high bandwidth network capabilities. VR also 
requires developing new technologies in displays 
that update in real-time with head motion; 
advances in sensory feedback such as force, 
touch, texture, temperature, and smell; and, 
intelligent models of environments. 

With future increases in technological capability 
VR holds the promise to provide significant 
improvements in many new application areas. 
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Case Study 11 

HPCC and Education 




HPCC, science education and science research 
are ushering in a new era of leaming. Through 
hands-on activities, state-of-the-art experiments, 
and novel interactive advanced computing and 
communications technologies, high school stu- 
dents immerse themselves in cdticationai materi- 
als based on cutting-edge, truly modern science 
research. Closer linkages and shared methods 
between students and research scientists help 
attract students of many backgrounds to science 
as a subject and as a profession. 



scientific advances and methodologies with their 
own education. In addition, a growing number 
of HPCC funded programs such as SuperQucst 
provide individual students with access to high 
performance computers for student-directed 
research projects. The two research projects 
described below illustrate the usefulness of both 
approaches. In many cases, these activities lead 
to science and technology careers for students 
.vho previously considered these careers outside 
of their reach. 



The major impact of HPCC technologies on edu- 
cation will follow the growing integration of 
HPCC technologies with inquiry-based science 
leaming in the classroom. Direct collaborations 
with professional scientists and engineers, car- 
ried o\er high bandwidth networks, allow teach- 
ers and students o dynamically integrate new 



Learning Through Collaborative 
Visualization 

The Learning Through Collaborative 
Visualization testbcd explores educational uses 
of scientific visualization and collaborative soft- 
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ware tools through shared computer workspaces 
and two-way audio/video connections. In this 
project, students and teachers near Chicago 
(s flown on previous pci^e) are working on meteo- 
rology with atmospheric scientists and graduate 
students in Champaign-Urbana, and will be 
joined in 1993 by students and teachers in 
Michigan. Together, they will study the model- 
ing of unusual weather patterns in their area, uti- 
lizing real-time weather data from satellites and 
other sources, such as clouds, temperature and 
moisture. Any current information on weather, 
such as the impending conditions giving rise to a 



developing storm, can be accessed using net- 
works and displayed using local visualization 
tools, by researchers and students alike. 



Diffusion Limited Aggregation 

Diffusion limited aggregation (DLA) structures 
arise naturally in fields of science, ranging from 
electrochemical deposition and dendritic solidifi- 
cation to various breakdown phenomena such as 
dielectric breakdown, viscous fingering, chemi- 
cal dissolution, and the rapid crystallization of 




Color-coded electric field in the vicinity of an electrical conductor molded in the shape of a recently discov- 
ered DLA fractal object. The high school student performing the research was a finalist in the 1993 
Westinghouse Science Talent Search. 
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lava. Il is not surprising then thai there is much 
imeresi in the computer modeling of DLA and 
its variants. Using the computer simulation of 
DLA. the student can discover new structures 
that are aesthetically beautiful and at the same 
time have physical meaning. Students model 
structures ranging from snowHakes to cancer 
cells. In the illustration, a student models 
straight DLA and ascertains its potential energy 
distribution along the perimeter. As a conse- 
quence, the student discovers that the most 
active regions on the cluster are near the tips. 



SPONSORING AGHNCILS AND 
ORGANIZATIONS 

ED 

NSI" 



PERFORMING ORGANIZATIONS 
Bellcore 

High Schools in Illinois and Michigan 

Learning through Collaborative Visual! /at ion 

National Center for Supercomputer Applications 

Northwestern L'niversit). Depaiinient of Ps)cholog\ 

San Francisco Exploratoriuni 

Univ ersity of Illinois at Chanipaign-l-rbana 

I'niversitN of Michigan. Computer Science 



Technology-Dissemination Participants 
Anieritech 

ScienceKit Publishers 

Technical Hducation Research Center and affiliated 
(national ) LabNet teachers 



Diffusion Limited Aggregation 
Akron High School. Akron. Oil 
Boston l'ni\ersit\. Boston. MA 



ERLC 



147 



Case Study 12 

HPCC Community Resources 




Making effective use of high performance com- 
puters requires considerable expertise in diverse 
areas such as computer architecture, algorithms, 
numerical analysis, and applied mathematics. 
The need for insights in all of these arenas is a 
serious stun.bling block to a researcher whose 
primary interest is in a particular physical appli- 



cation. An essential key to making high perfor- 
mance computers generally usable in today's 
fast-paced research environment lies in the 
development and dissemination of reusable soft* 
ware that encapsulates the expertise of computer 
scientists and numerical analysts. 
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A wealth of reusable software for solving recur- 
ring mathematical and statistical problems is 
already emerging. Unfortunately, the volume of 
this software and its distribution over 
labyrinthine computer networks has made it 
quite difficult for the average user to locate 
appropriate tools. 

The Guide to Available Mathematical Software 
(GAMS) is a centralized software resource 
maintained for scientists at the National Institute 
of Standards and Technology (NIST). GAMS 
functions like a management and retrieval sys- 
tem for a large central software repository. 
However, instead of maintaining the cataloged 
softw **e itseH\ it provides a seamless cross- 
index to mu pie repositories managed by oth- 
ers. The ter virtual software repository has 
been used to o scribe systems of this type. 

The steadily increasing collection of software 
indexed by GAMS now numbers more than 
9,200 software modules in about 60 mathemati- 
cal and statistical software packages available 
from four physically-distributed software reposi- 
tories, including the well-known netlib collec- 
tion of public-domain research software main- 
tained jointly by Oak Ridge National 
Laboratory, AT&T Bell Laboratories, and the 
University of Tennessee at Knoxville. Users 
access GAMS anonymously by logging in to a 
server system on the Internet. Searches based 
upon problem classification, keyword, or name 
may be used to locate appropriate software, after 
which items such as abstracts, documentation, 
examples and source code can be retrieved. 
Both generic and networked (XI 1) graphical 



user interfaces to GAMS have been developed. 

The classification-based retrieval technology 
used in GAMS is not unique to mathematics and 
statistics. The system itself can be easily recon- 
figured to foster the reuse of software in any 
application field. 

Future directions for the GAMS system include 
support of the system as a public Internet 
resource, development of networked GAMS 
clients and servers, development of improved 
classification schemes, and research in alternate 
search mechanisms, including domain-depen- 
dent expert system methodologies. 

GAMS is a component of an experimental soft- 
ware exchange being coordinated for the HPCC 
by the NASA Goddard Space Flight Center. The 
experiment facilitates the development and eval- 
uation of multiple approaches to the problem of 
software reuse in pursuit of an open non-propri- 
etary architecture to facilitate the emergence of a 
national software exchange. 



SPONSORING AGENCIES AND 
ORGANIZATIONS 

NAS.^ 

NIST 



PERFORMING ORGANIZATIONS 
AT&T Bell Laboratories 
NAS.^ 
NIST 

Oak Ridye National Librar\ 
l.'nivcrsiiy of Tennessee - Knowille 
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Case Study 13 

Process Simulation and Modeling 



Injection 




Results of a computer simulation of a liquid molding process for manufacturing high strength polymer com- 
posite automotive body panels. The simulation shows how the liquid polymer is injected into the mold and 
predicts 'he flow front position as a function of time. The results of the simulation are used to better under- 
stand the design of a particular mold and part and to select polymers and preplaced fiber preforms. 



In ihc future, one of the keys to optimizing new 
product designs and manufacturing processes 
will be the ability to model and simulate produc- 
tion methods using advanced computer hardware 
and software. Today, the development of many 
products, including those that require castings, 
forgings and injection- molded parts, for exam- 
ple, typically require lengthy and expensive pi'o- 
totyping and experimentation to refme details of 
the product design, tooling, and manufacturing 
parameters. The use of computerized process 
modeling and simulation will eliminate much of 
this prototyping and dramatical I \ reduce producl 
development times and costs. 

The traditional approach of using experimenta- 
tion and protiUsping to refine pioduction pro- 
cesses is indicative of the faci that manufactur- 
ing piadices liavo lii>l(Micali\ been hasctl as 



much on "art" as on sound scientific understand- 
ing of the processes involved. This is changing 
rapidly as a result of research to achieve better 
theoretical understanding and predictability of 
specific processes and materials and their effect 
on product performance and costs. Improved 
theoretical frameworks are advancing progress 
on a wide range of manufacturing applications, 
processes and materials, including stamping and 
forming, machining, powder compaction pro- 
cesses LHid ev ,n assembly of pans. 

Princess modeling and simulation is being pur- 
sued by a number of organizations* including the 
National Institute of Standards and Tcchnologv 
(NTST). For example, as part of a cooperative 
agreement vsith Ford. Chrvsler and General 
Motors. NIST is conducting research into the use 
ol'pol>mer composites for sirucuiral applicaliiMis 
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in aiiloiiiobilcs. As part o\' the project. NIST has 
developed a finite element simulation of the 
mold nilinii process used to manufaclure high 
strength body components. In a similar manner. 
NIST is developing process moc'els and simula- 
tions for robotic maniii'acturing operations and 
production of powder metal particles. 

Much oT the ability \o apply new theoretical 
understanding depends on the performance and 
cost of advanced ciMiiputing technologies. 
Process modeling and simulation draws heax ily 
on computationally intensi\'e techniques in such 
areas as heat transfer and solidification kinetics, 
coupled lluid How, finite difference approxima- 
tions, turbulent viscosity calculations, fracture 



mechanics, stress analyses, and three-dimension- 
al graphics and visualization techniques. 
Adv anced computing technology directly affects 
the speed and le\el of detail that can be incorpo- 
rated inti^ the models, and therefore the realism 
and benefits that can be obtained. 



SPONSORING AGENCIHS AND 
ORGANIZATIONS 

Auti^nioiivc Composites Consortium 

NIST 

PERFORMING ORGANl/ATIONS 
Autoni(ni\c Coniposiie> Consoniinn 
NIST 
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Case Study 14 



Semiconductor Manufacturing for the 
21st Century 




The results of applying a fully-scalable - arallel iterative matrix solver to create a three-dimensional simula- 
tion of current flow in a bipolar transistor are shown. The transistor was simulated on the Intel Delta at 
Caltech using software developed at Stanford University. This simulation is the largest yet in this field and 
represents the state of the art in three-dimensional device modeling. Such modeling efforts enable pro- 
cess design in the "Virtual Factory. " 
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Scmiconducior manufacturing plants today arc 
characicri/.cd by high capital costs and low 
nexibilily. They arc built lo serve one or two 
generations of technology and usually a narrow 
product base. New technology developn'teni is 
ver>' expensive and largely empirically done. To 
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be competitive in such an environment requires 
high capital investment. 

in the 197()s» chip designers faced similar invest- 
ineni problems because new designs were large- 
ly hand crafted. As a result, few VLSI (Very 
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Large Scale Integration) applications were 
viewed as being able to justify design costs. 
The CAD (Computer-Aided Design) revolution 
changed this situation by empowering a vastly 
increased number of creative people with the 
ability to design chips at low economic risk. 
The CAD revolution also provided first pass suc- 
cess in most cases on new designs. 

A current view, widely held, is that a similar rev- 
olution using the same general approach can rev- 
olutionize manufacturing. The concept is to 
build a highly flexible computer controlled man- 
ufacturing facility; a "Programmable Factory." 
in parallel with this factory, a suite of simulation 
tools would be constructed; a "Virtual Factory" 
capable of emulating all functions of the real 
factory. Both of these facilities would be con- 
trolled and integrated through a Manufacturing 
Automation Framework (MAF). The compari- 
son of actual results from the real factory with 
predicted results from the Virtual Factory pro- 
vides a means for improving models. 

One example of work in progress is ongoing at 
Stanford University supported by ARPA. Here, 
the overall aim is to implement a basic version 
of these constituents in a working IC (Integrated 
Circuit) facility and to demonstrate the power of 
this approach in developing and applying new 
technologies. Much of the work in the first two 
years of this project has focused on developing 
specific software tools needed for the Virtual 
Factory such as simulators and design tools; 
developing the software needed for the 
Automation Framework including information 



storage methods and frameworks for linking 
software tools; and putting into place the hard- 
ware and software tools needed to connect the 
Virtual Factory to the Programmable Factory. 

Recent accomplishments include an integrated 
demonstration of the concept including opera- 
tional prototypes of many of these tools. More 
than 20 different projects in the research pro- 
gram were integrated together to show the power 
of connecting the Virtual and Real Factories to 
an audience of more than 100 people from 
industr)', government and universities. Scalable 
algorithms, developed on a workstation, were 
used to demonstrate an extremely large three- 
dimensional device simulation; a major new 
software tool, SPEEDIE, which simulates thin 
film etching and deposition steps in IC manufac- 
turing, has been released to industry; and a new 
multiprocessing reactor designed to perform 
multiple manufacturing steps in a single machine 
is being used to test new manufacturing concepts 
in the real factory. 

SPONSORING AGENCIES AND 
ORGANIZATIONS 
ARPA 

Digital Equipment Corporation 

Semiconductor Research Corporation 

Stanford Center for Integrated Systems industrial 

sponsors 
Texas Instruments 

PERFORMING ORGANIZATIONS 
Stanford University 
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Case Study 15 

Advances Based on Field 
Programmable Gate Arrays 




Splash 2 board, containing Field Programmable Gate Arrays, which attaches to a v^crkstation. It is pro- 
grammed in the DOD standard VHDL language and can achieve high performance on problems such as 
DNA and protein sequence comparison. 



Since computers were first built in the I94()s and 
l9.S()s, the structure of their processors has been 
fixed at the time of their construction. As a 
result, even the fastest computers will perform 
poorly on a computation whose structure is a bad 
match for that of the processor. 



This basic feature of processor architecture is 
changing with the use of Field Programmable 
Gate Arrays (HPGAs) as processor elements. 
The hardware of an FPGA-based computer is 
reconfigured for each application. In this way, 
the structure of the processor can be made to 
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nialch the structure of the conipulalioii. and an 
FPGA-based computer can achieve supercom- 
puter performance on a range of applications at a 
fraction of the cost. Importantly, the reconfigu- 
ration of the processor structure is done not by 
designing new computer hardware but by pro- 
gramming the FPGA-based computer in a stan- 
dard high-level language. 

The Splash 1 and Splash 2 attached processor 
systems, which were designed and built at the 
Supercomputing Research Center (SRC) using 
FPGAs from Xilinx. Inc.. are just this kind of 
FPGA-based reconfigurable computer. Together 
with the National Cancer Institute, the SRC is 
writing software that will perform DNA and pro- 
tein sequence comparisons and alignment on 
existing databases at speeds equal to or greater 
than those of supercomputers. Applications for 
Splash 2 are written in VHDL (the DOD stan- 
dard Very High Speed Integrated Circuit 
Hardware Description Language). On applica- 
tions running on Splash 2, performance equal to 
or as much as 100 times that of some conven- 
tional supercomputers has been achieved. 

The CM-2X. built b\ Thinking Machines, Inc. 
for the SRC, is a CM-2 in which the VVeitek 
floating point accelerator chips have been 



replaced by Xilinx FPGAs, which can be pro- 
grammed with the usual CM-2 languages and 
utilities. It is common on multiprocessor 
machines to find such floating point accelera- 
tors: the use of FPGAs in their place allows 
computationally intensive kernels of an applica- 
tion to be executed on FPGA-based hardware 
specifically configured for the application. On 
complete applications programmed at the SRC. 
the CM-2X has achieved three to four times the 
performance of the CM-2. 

Similar approaches are being evaluated for other 
architectures. For example, the CM-5, also built 
b\ Thinking Machines, Inc.. has from 32 to 
1.024 network-connected nodes each consisting 
of a high performance microprocessor and four 
custom designed vector processors. Embedding 
FPGAs into its nodes and network offers the 
potential for producing dramatic improvement 
on specific applications and, by altering the 
FPGA programming, observation of internal sys- 
tem states to assist in program tuning and debug- 
ging. 

SPONSORING AGHNCIES AND 
ORGANIZATIONS 
N.SA 



Case Study 16 

High Performance Fortran and Its 
Environment 



In an effort to provide a machine- independent 
programming interface, a working group of rep- 
resentatives from industry, academia and gov- 
ernment laboratories has defined an informal 
standard called High Performance Fortran 
(HPF), HPF consists of language extensions to 
Fortran 90 that support data-parallel program- 
ming by permiuing specification of the distribu- 
tion of data structures across the piocessors of a 
scalable parallel computer system. The ideas 
behind HPF have been taken in large part from 
earlier research on a language called Fortran D. 
This work, which was conducted at the Center 
for Research on Parallel Computation at Rice 
University and at Syracuse University, was 
sponsored under the HPCC Program by NSF and 
ARPA. The Fortran D project designed a scal- 
able language on the basis of analysis of existing 
parallel applications, prototype compter imple- 
mentations and an extensive benchmark suite 
that arc all available to the HPCC community. 
The HPF draft standard, which was produced 
over a single year, promises to dramatically 
reduce the burden of specifying parallel scientif- 
ic programs for the new generation of massively 
parallel computer systems. Four companies 
have already announced HPF compilers that will 
he available in 1993. HPF will accelerate the 
use of parallel machines, as now users can use a 
high level software with the assurance that their 
applications will be supported by future as well 
as current systems. 

Since HPF hides many of the details of parallel 
programming for a specific target machine, the 
programmer will need assistance in preparing, 
debugging and tuning HPF programs. To this 
end, ARPA is sponsoring a research project at 
Rice University and the University of Illinois at 



Champaign-Urbana to design and build a collec- 
tion of programming tools for HPF, including an 
intelligent editor to help construct efficient data 
distributions, a debugger to locate data races and 
other programmer errors and a performance 
analysis and visualization system. This project 
has a secondary goal of providing a platfomi for 
the development of other software tools for HPF. 
When complete, this software platform will be 
distributed throughout the computational science 
community in source form. 

The current version of HPF supports data paral- 
lel programming for about 50-75 percent of 
applications but has limited support for "unstruc- 
tured" or "irregular" problems. Since this class 
includes many important science and engineer- 
ing problems, NASA, ARPA. ONR and NSF are 
jointly sponsoring a research project at Rice. 
Syracuse and the University of Maryland to 
design and implement extensions to HPF to sup- 
port this important problem class. This work 
will affect the next round of HPF standardiza- 
tion, scheduled for calendar year 1994. 



SPONSORING AGENCIES AND 
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Jacobi iteration, using HPF: 

REALX(N,N), Y(N,N) 
IHPF$ DISTRIBUTE (*.BLOCK)::X,Y 

FORALL( J = 2:N-1 ) 

FORALL( I = 2 : N-l ) 
X(IJ) = 0.25 * (Y(I-1,J) + Y(I+KJ) + Y(I,J-1 ) + Y(IJ+1 )) 

ENDFORALL 
END FOR ALL 



Jacobi iteration, using message passing: 

REAL X(N,N„OVER„P), Y(N,0:N_OVER_P+1) 

IF(MY_ID.NE. 0)THEN 
SEND( Y(I:NM),MY_ID-I ) 
END IF 

IFCMYJD.NE. P-1)THEN 
SEND( Y(1:N,N_0VER_P), MYJD+l ) 
END IF 

IF(MY_ID .NE. P-l)THEN 
RECEIVE( Y(l:N.N_OVER_P+n, MYJD+l ) 
END IF 

IF(MYJD.NF. 0)THEN 
RECEIVE( X(l:N,()), MYJD-1 ) 
END IF 
LOW= I 

IF(MYJD .EQ.0)LOW=2 
HIGH = N_OVER_P 

IF(MYJD .EQ. P-l) HIGH=N_OVER^P-l 
DO J = LOW,HIGH 
DO I = 2, N-l 

X(IJ) = 0.25 * (Y(I-I.J) + Y(I+LJ) + Y(IJ-l ) + Y(IJ+1)) 
END DO 
END DO 



These code segments both perform square mesh Jacobi relaxation on a distributed memory parallel com- 
puting system. 
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Glossary 



ACTS 

Advanced Communications Technolog\ Satellite, part of a joint NASA-ARPA NREN col- 
laboration that will provide high speed ATM/SONET transmission, and will provide inter- 
face and operations experience in mating high speed terrestrial communications systems wiih 
high speed satellite communications systems 

Algorithm 

A procedure designed to soUe a problem. Scientific computing programs contain algo- 
rithms. 

ARPA 

Advanced Research Projects Agency, part of DOD (formeri\ DARPA. Defense Advanced 
Research Projects Agenc\ ) 

ASTA 

Advanced Software Technology and Algorithms, a component of the HPCC Program 
ATDnct 

Advanced Technology Demonstrations Network, an ARPA project that will make use ot 
lechnologN dt %eloped Tor and by gigabit testbeds 

ATM 

Asynchronous Transfer Mode, a new telecommunications technology, also known as cell 
switching, which is based on 53 byte cells 

Backbone Network 

A high capacity electronic trunk connecting lower capacity networks, e.g.. NSFNET back- 
hone 

Hit 

Acronym for binary digit ^ 
BRHR 

Basic Research and Human Resources, a component of the HPCC Program 
Byte 

A group ot adjacent binary digits operated upon as a unit (usually connotes a group ol eight 
bits) 

CLNP 

Cow 'cli(MiLess Network Protoc(^l 

Computer Kugineering 

The creative application of engineering principles and metluuis to the design and develop- 
nvMit of haidware and software ss stems 
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Computer Science 

The systematic study of computing systems and computation. The body of knowledge result- 
ing from this discipline contains theories for understanding computing systems and methods; 
design methodology, algorithms, and tools; methods for the testing of concepts; methods of 
analysis and verification; and knowledge representation and implementation. 

Computational Science and Engineering 

The systematic application of computing systems and computational solution techniques to 
mathematical models formulated to describe and simulate phenomena of scientific and engi- 
neering interest 

CPMES 

Committee on Physical. Mathematical, and Engineering Sciences 
DOC 

Department of Commerce 
DOD 

Department of Defense 
DOE 

Department of Energy 
ED 

Department of Education 
EPA 

Environmental Protection Agency 
ESnet 

Energy Sciences Network 
FCCSET 

Federal Coordinating Council for Science, Engineering, and Technology 
FDDI 

Fiber Distributed Data Interface 
Flops 

Acronym for floating point operations per second. The term "tloating point" refers to ihal 
format of numbers that is most commonly used for scientific calculation. Flops is used as a 
measure of a computing system's speed of performing basic arithmetic operations such as 
adding, subtracting, multiplying, or dividing two numbers. 

FNC 

Federal Networking Council 
Giga- 

10' or billions of ... (e.g.. gigabits, gigaflops, gigaops) 
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GOSIP 

Government Open Systems interconnection Profile 
Grand Challenge 

A fundamental problem in science and engineering, with broad eco*^omic and scientific 
impact, whose solution can be advanced by applying high performance computing techniques 
and resources 

Heterogeneous system 

A distributed system that contains more than one kind of computer 

High performance computer 

Al any given lime, that class of general-purpose computers that arc both faster than their 
commercial competitors and have sufficient central memory to store the problem sets for 
which they are designed. Computer memory, throughput, computational rates, and other 
related computer capabilities contribute to performance. In addition, performance is often 
dependent on details of algorithms and on data throughput requirements. Consequently, a 
quantitative measure of computer power in large-scale scientitlc processing is difficult to for- 
mulate and may change as the technology progresses. 

High performance computing 

Encompasses advanced computing, communications, and information technologies, includ- 
ing scientific workstations, supercomputer systems, high speed networks, special purpose 
and experimental systems, the new generation of large scale parallel systems, and systems 
and applications software with all components well integrated and linked over a high speed 
network 

HIPPI 

High Performance Parallel Interface 
HHS 

Department of Health and Human Services 
HPCC 

High Performance Computing and Communications 
HPCCIT 

High Performance Computing. Communications, and Information Technology Subcommittee 
HPCS 

High Performance Computing Systems, a component of the HPCC Program 
IINREN - see Interagency Internet 
HTA 

Information Infrastructure Technology and Applications, a component of the HPCC Program 
Interagency Interim NREN - see IntcragencN Internet 



Interagency Internet 

The federally funded pari of ihc Iniernet lhai is direclly used by the HPCC Program. Il 
ineludes NSFNET, ESnet, and NSI. The Interagency hiternet is also the name of an element 
of the NREN component of the HPCC Program, and is the successor tt^ the hiteragency 
Interim NREN (IINREN). 

Internet 

The global collection of interconnected, multiprotocol computer networks including Federal, 
mid-level, private, and international networks. The Interagency Internet is a part of the 
hiternet, and NSFNET, ESnet, and NSI are part of the Interagency Internet. 

InterMC 

Internet Network Information Center 

Interoperability 

The effective interconnection of two or more different computer systems, databases, or net- 
works in order to support distributed computing and/or data exchange 

ISDN 

Integrated Services Digital Network 
Kb/s 

Kilobits per second or thou.sands of bits per second 
LAN 

Local Area Network 
Mb/s 

Megabits per second or millions of bits per second 

MIMD 

Multiple Input Multiple Data 

MPP 

Massively parallel processor 
NAPs 

Network Access Points, a set of nodes connecting mid-le\el or regional networks and other 
service providers to NSFNET 

NASA 

National Aeronautics and Space Administration 
National Challenge 

A fundamental applicaticMi that has brcnid and direct impact c^i the Nation's competitiveness 
and the well-being of its cili/ens, and that can benefit by the application ol' HPCC technolog\ 
and resources 
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National Information Infrastructure (Nil) 

The inlcgraiion of hardware, software, and skills that will make it eass and affordable to eon- 
necl people \s iih each other, with computers, and u ith a vast array of services and informa- 
tion resources. 

NCO 

National Coordination Office for High Performance Computing and Coninumications 
Network 

Computer communications technologies thai link multiple computers to share informati(Mi 
and resources across geographically dispersed locations 

NIH 

National Institutes of Health, part o\' HHS 
NIST 

National Institute of Standards and Techni)k)gN. part of DOC* 
NI.M 

National Library of Medicine, part of NIH 
NOAA 

National Oceanic and Atnmspheric Adminisiratiim. part ()f DOC 
NRKN 

National Research and lulucation Network. The NRKN is the reali/atit^n t)f an interc()nnect- 
ed gigabit cimipuler netwiirk system demoted t(> HPCC. NRHN is alsti a c()mpt)nenl of the 
HPCC Program. 

NSA 

National Securit\ Agenc\. part ()f DOD 
NSF 

National Science l oundatitin 

NSFNKT 

NSh computer network 

NSl 

NASA Science Internet 
NTIA 

National Telecommunications and Information Administration 
()C-3 

Network transmission speed of \5> Mb/s 
0( 12 

Network transmission speed of ^22 Mb/s 
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0MB 

OMkc I)!' Managcnicnl and Budgtn 



Ops 

Acronv 111 for opcraiiotis per second. Ops is used as a r^i: ^! of ihe speed of eoinpuler svslenis 
and eoniponenis. In ill is rcporl ops is general Is lakcn lo mean iho usual inleger or Hoaling 
point operations depending on what funeiional units are included in a particular sxsteni cimi- 
figuralion. 

OSI 

Open S\ stems Interconnection 
OSTP 

OlTice of Science and Technologv Po\'\c\ 
Parallel processing 

Simultaneous processing b\ more than one processing unit on a single application 
Pela- 

10'' of... (e.g,. pelabits) 
Port 

Transport a computer program from one computer s\ stem to another 
Portable 

Portable computer programs can be run with little or no change on nian\ kinds of computer 
systems. 

Prototype 

The original demonstration model of what is expected lo be a scries of s\sicms. FVolot\pes 
arc used lo pro\e fcasibilitx. but often are not as efficient or well-designed as later proiiuction 
nuKiels. 

R&I) 

Research and development 
Scalable 

,\ system is scalable if it can he made to have more (or less) computational pi>\\er b\ config- 
uring it v\ith a larger (or smaller) number of pri>cessors, anuuint oi mcmor\. intcrctMinection 
handwidih. inpul/ouiput bandwidth, and amount of mass storage. 

SIMI) 

Single Instruction Multiple Data 

SONKl 

Synchronous Optical NelwcMk 

IVra- 

10' or inlhons oi le g., icrabiis. tciallops) 
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Tl 

Nolwork iiViiismission i>l a 1)S I lonnattcci digiial Mgiui! ul a rate o\' 1.5 Mb/s 

Network iiaiisinission ot a IXS.^ lorni.Uiotl digital signal at a rate (>r4."S Mh/s 
vBNS 

Vlmt high speed iiaekbone Network Serviees 

WAN 

Wide Area Network 




Contacts 



NCO (National Coordination Office for High Performance Computing and 
Communications) 



Bldg. 38A/B1-N3() 
8600 Rockville Pike 
BethesdiuMD 20894 
301-402-4100 
fax: 301-402-4080 
nco(3*lipcc-gov 

Donald A. B. Lindbcrg. M.D. 
Director 

1 i ndberg (j?^ hpcc.gov 

Patricia R. Carson 
Exci Htive A ss is tiuu 
cars(MiC«1ipcc.gov 



Sally E, Howe, Ph.D. 

Assistant Director [or Technical Proi^rams 

NfST 1992-^3 Commerce Sciei.ce and Technology (ComSci) l-'eliow 
howeCaMipcc-goN' 

Charles R. Kalina 

Executive Secretary, HPCCIT Stthconnnittee 
kalina(?'hpcc-g(n 

Calvin T. Ranu^s 
Fr( >ii rani A ss( h iate 

NASA 1992-93 Pn^fessional rXnelopment Program 
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ShaiHKMi N- Uncangc(^ 
Staff Assist(uit 
uncangc(^ (?' h pec . g(^ v 

Patricia N. Williams 
Information Officer 
pwilliams(«1ipcc.g(n 



HPC(^ Inlernct Server 

vvvvvv.hpcc.gcn 
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InterNIC Information Services 

General Atomics 

PO Box 85608 

San Diego. CA 1 86-9784 

800-444-4345 

619-455-4600 

fax: 619-455-3990 

i nib C^'' intern ic.nel 



ARPA 

l.t Col John C. Toole 

Actiiiii Direc tor. Coinpuiini> Systems Technol()\*\ Office 

Advanced Research Projects Ai^ency 

3701 N. Fairfax Dr. 

Arlington, VA 22203 

7(V'^ -696-2264 

tooIeC« arpa.mil 



Stephen L. Squires 

Special Assistant to the Director 

Advanced Research Projects A^iency 

370! N. F-'airfax Dr. 

Arlington. VA 22203 

703-696-2226 

squiresCfl arpa.mii 

Randy Kat/. Ph.D. 

Prciirani Manai^cr for Jnj'ornuaion liijrastrncture Technoloy^y 

Advanced Research Projects A^^ency 

3701 N, Fairfax Dr 

Arlington. VA 22203 

703-696-2228 

kal/(« arpa.mii 



167 



DOE 



HPCC Program Coordinator 

Office o f Scienti fic Compntiny, 

ER-Ml GTN 

Depa nment of Enei i^y 

Washiiigion, DC 20585 

301-9{).V58{)() 

lipcc(?'er.doe.i2ov 



ED 

James A. MilchcIL Ph.D. 
Special Assisuuu for Technoloi^y 
Office of the Ass istant Secretary 
Department of Education 
555 New Jersey Ave., NW #6048 
Washington, DC 20208 
202-219-2053 
jniitcheiC«M net.cd.gov 



EPA 

General inibrmation: 
Joan H. Novak 

HPCC Proi^ram Maiuii^er. MD-SO 
Environmental Protection A\icncy 
Researeh Triangle Park. NC 2771 1 
919-541-4545 ^ 
novak,joanC« epaniail.epa.gov 



Robin L. Dennis. Ph.D. 

Senior Science P rot: ram Ma nailer 

Environmental Protection Ai;enc\ 

Research Triangle Park. NC 277 1 1 

919-541-2870 ^ 

rdennisC«'nyer.nese,org 

Iniernet use: 

Bruce 1\ Almich 

EPA Eederal Network Cinnu il Representative, Ml) 
Environmental Protci tion Ai^enc\ 
Research Triangle I^irk. NC 2771 1 
9l9-54!-33()r> 

alniich.hiuceC^ epaniail.ej^i.gov 
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NASA 



Lcc B, HolctMiib 

Dirci tor. Hii^h Perfonminrc Compntinii (ind CoiiunuiiU iuioiw Office 
Office ofAvrunauiics 

Saii(mal Acn^nautics and Space Aduunistwiion 
Code RC 

VVashingion. D.C, 20546 
2()2-35S-2747 

i_holcoinbC^ iicrDiiiail.hq.iiiisii.gov 

Paul H, Sinilh. Pli.D. 

Program Maiiai^ci: liPCC 

Natiaual Aeronautics and Space Adniinisiraiirn 

Code RC 

Washinglon. D.C. 20546 
202-358-4617 

ph_smilh(? aeromail, hq.iiasa.gov 
Paul E. Hunter 

HPCC Proi^rani Mainii^cr for Basic Research and Edneafion 
National Aeronaulics and Space Administration 
Code RC 

Washinglon. D C. 20546 
202-35X-461S 

P_Hunler(o aeroniaiLhq.nasa.gov 



NIH 

NIII HPCC Coordinator and NLM contact: 
Daniel R. Mas\s. M.D. 

Dirci tor. Lister Hill Xational Center for Biomedical Connnnnications 

Xational Library of Medicine 

BIdg. 3SA/7.\707 

Bethesda. NH) 2()S^)4 

301-496-4441 

niasN \(p llic.nlni.nih. gov 

N'CRR program: 

Judilh Vailukailis. M.l). 

!)ire( tiu\ Xational C'cnter lor Research Resources 

Xational Institutes oj Health 

Bldg. 12A/4007 

Bclhcsda. Ml) 20X02 

301-406-5703 

lUih \ ' i nihrri 2a.hiinci(« cu.nih.gox 
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Caroline Hollow ay. Ph.D. 

Director. Office of Science Policy diul Conununication 

National Center for Research R e so i trees 

National Institutes of Health 

BIdg. 12A/4()57 

Beihesda, MD 2()H92 

301-496-2^)^)2 

CaroiincH(«'nihrrl2a.biinci 



DCRT program: 

Da\id Rodbard. M.D. 

Director, [division of Compwer Research and Technolo^iy 

National Institutes of Health 

BIdg. 12A/3()33 

Beihesda. MD 20892 

301-496O703 

dar^'cu.nih.goN 

William L. Risso 

Deputy DireCor, Division of Computer Reseiirch and Technoloi^y 

National Institutes of Health 

BIdg. I2A/3033 

Beihesda, MD 20S92 

30 ; -496-8277 

risso (?' iiih.gov 

Roberi L. Mariino, Ph.D. 

Chief Computational Bioscience and Euiiinecrin^i Laboratory 

Division of Coir pater Research and I'cchnoloi^y 

National Institutes of Health 

BIdg. i2A/2()33 

Beiiiesda. MD 20892 

30 1-496- II 1 1 

inartinoCf^ nlw .nih.go\ 



NCI/BSC program: 

Jacob V. Mai/el- Ph.D. 

Bi(imedical Supercomputer Center 

National Cancer histituie 

Frederick Cancer Researt li iaciln\ 

301-846-3332 

jmai/elC<^' IcrlN I .ncilci l.gox 
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NIST 



CiLMicral inibi nuuioii: 
James H. Burrows 

Director. Conipufcr sSy stems I^ihoratory 

Nai.'onal Institute of Standards and Teehnolo\^\ 

Tochm)l()gy Building. Rddiii BI54 

GnithLMsburg. MD 2()S99 

301-975-2X22 

burrows C<?'ccf.iicsl. II ist -gov 



NOAA 

General iiitbrnialioii: 

Thoiiuis N. Pyke. Jr. 

[director for Hii^li Perfonuanee Con}pntin\* and Conimnnieations 
National Oceanic and Atmospheric Administration 
1315 I-ast-West Highway 
Room 153(){) 

National Oceanic and Atmospheric Administration 

SiKer Spring. MD 209 10 

301-713-3573 

t p \ ke (f^ h pec . n o a a . g o \ 



Directors oi high performance computing centers: 
.lcrr\ Mahlman. Ph.D. 

Director, Ge(tphysical fluid Dynamics L.ahoratory 

Sational Oceanic and Atmospheric Adtninistration 

P.O. Bo\ 308 

Princeton. NJ 08542 

609-452-6502 

jmC'' gi'dl.go\ 

Ron MacPherson. Ph.D. 

/>//<•( tor. \ationa! Meteoroh)i:ical Center 

Xfitiofhd Oceami (md Atmospheric Admiiiistratioti 

5200 Auih Road. Room 101 

C amp .Springs. MD 20746 

30I-763-S0I6 

i"onmcp(fT nic.lh-l.noaa.g(n 
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Sandy MacDonald, Ph.D. 

Director, Forecasnni* Systems Uihoratoiy 

National Oceanic an J Atmospheric Administration 

325 Broadway 

Boulder CO k)..03 

303.497.6378 

niacdonald (fl- fsl.noaa.gov 

Internet Use: 

Robert L. Mairs 

Chief. Information Processinji Divisi(m 

Office of Satellite Data Frocessint^ and Distrilmtion 

Nafi(mal Oceanic and Atmospheric Administration 

FB4- Room 0301 

Siiitland and Silver Hill Roads 

Suitland. MD 20746 

301-763-5687 

niiairs(^?^ncsdis. noaa.gov 



George Cotter 

Chief Scientist 

National Security Ai^ency 

9800 Savage Rd. 

Ft. Meade, MD 2()755-6()()() 

.M) 1-688-6434 

ii ivo\ I e (fi" a It e r 1 i I'e . n e se .mil 



Merrell Patrick. I^h.IX 
ilPCC Coordinator 
Nati(m(d Science lumndation 

l>irectt>rate for Computer and Inlbnnation Science and Hngineering 
4201 Wilson Bl\d., Room 1 105 
Arliniilon. VA 22230 



NSA 



NSF 



703-306- 1900 



mpalrickC" iisl.gtn 
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